DESCRIPTION 

RECORDING MEDIUM, REPRODUCTION DEVICE, PROGRAM, AND 
REPRODUCTION METHOD 

Technical Field 
[0001] 

The present invention relates to the field of copy 
control imposed on digitized movie films. More 
particularly, the present invention relates to the 
improvements made on incorporation of the copy control 
technology into recording media, such as BD-ROMs, used for 
movie distribution, and also into playback devices. 

Background Art 
[0002] 

Those who related to the film industry, such as the 
Hollywood, are on strict guard against copying of digitized 
movie films. In view of the circumstances, DVDs, DVD 
players, and DVD recorders are provided with functionality 
for refraining from operations of making any copies of 
original works, including personal copies. 

More particularly, movie content is recorded on a DVD 
in form of data encrypted using an encryption key that is 
unique to the DVD. With this arrangement, even if movie 
content is simply copied to another recording medium, such 
an unauthorized copy is not available for any use. 
[0003] 

In addition, when outputting to a TV a progressive 



or interlaced video signal for movie playback, a legitimate 
DVD player embeds information called CGMS (CGMS-A: Copy 
Generation Management System-Analog in the case of analog 
output) into the output signals for imposing restrictions 
5 on recording. With the CGMS embedded into the content, 
an unauthorized recorder cannot record the video signal 
even if such a recorder is connected to the player. 
[0004] 

The patent literature listed below discloses copy 
10 control technology for DVD. 
[Patent Literature 1] 

JP Patent No. 3162049 

Disclosure of the Invention 
15 Problems the Invention is attempting to Solve 
[0005] 

Unfortunately, the total prohibition of copying has 
lead to some opposite effect of driving some users to 
illegally make personal copies using a tool called a ripper . 

20 As a consequence, the demand for rippers increases for making 
illegal copies, and many rippers are on the underground 
market. In other words, the total prohibition of personal 
copies for copyright protection has ironically led to 
expansion of the market for the illegal copying tools. 

25 [0006] 

The music industry similarly suffers from the 
widespread of illegal copies and thus has started to 
appreciate the concept of "pre-rip". According to the 



concept, CDs supplied to users stores in advance a pre-ripped 
or copiable version of the original content. Since an MP3 
copy is readily available, users are not motivated to obtain 
a ripper tool and make personal copies. The pre-ripping 

5 measurement has been successful to some extent as it reduces 
the motivation to make illegal copies. Unfortunately, 
however, this measurement requires a free space to be secured 
on CDs for storing a pre-ripped version. Unlike music data 
that is relatively small, movie content of high-quality 

10 image is large in data size. Even in a 50G-byte BD-ROM, 
it is practically impossible to secure enough space for 
storing a pre-ripped version. 
[0007] 

Since a certain size of free space on a recording 
15 medium is required, the conventional ripper measurement 
is not suitable for a recording medium storing movie content 
of high-quality images, which occupies most of the recording 
medium capacity. . 

In view of the above, the present invention aims to 
20 provide a recording medium used to store movie content with 
high-quality images and still capable of implementing 
pre-ripping approach . 

Means for Solving the Problems 
25 [0008] 

In an attempt to achieve the above aim, the present 
invention provides a recording medium having recorded 
thereon a video stream and a plurality of pieces of copy 



control information. The video stream contains video 
composed of a plurality of frame images. The plurality 
of pieces of copy control information indicates different 
restrictions on recordingof a video signal that is converted 
5 from the frame images. The restrictions differ depending 
on quality levels at which the video signal is output. 

Effects of the Invention 
[0009] 

10 According to the above structure, such setting is 

realized that recording of a high quality video signal is 
prohibited, while recording of a standard quality video 
signal is permitted. 

As long as the video signal is output at a standard 

15 image quality, users are permitted to readily obtain a copy 
of the standard image quality, simply by connecting an output 
terminal of the playback device to an input terminal of 
a recording device. 
[0010] 

20 Since a copy of a certain level of image quality is 

available simply by connecting the recording device to the 
playback device, users are not motivated to go through the 
trouble of obtaining a ripper to make illegal copies. As 
a result, there is an advantageous effect that users are 

25 no longer interested in making illegal copies. 

Brief Description Of The Drawings 
[0011] 



4 



Fig. 1 illustrates a form of using the recording medium 
according to the present invention; 

Fig. 2 illustrates the structure of a BD-ROM that is 
a recording media according to the present invention; 
5 Fig. 3 illustrates the structure of an application 

layer the recording medium according to the present 
invention; 

Fig. 4A illustrates the internal structure of BD.CCI; 
[0012] 

10 Fig. 4B illustrates one possible setting of CCIforHD 

and CCIforSD; 

Fig. 4C illustrates an example in which different 
levels of restrictions are imposed on recording of a video 
signal; 

15 Fig. 5 schematically illustrates the structure of a 

file with the extension ".M2TS"; 

Fig. 6 illustrates the internal structure of Clip 
information; 

Fig. 7 illustrates the structure of PL information; 
20 Fig. 8 illustrates the relationship between an AV clip 

and PlayList information; 

Fig. 9 illustrates a playback section defined on a 
SubClip timeline and control defined for synchronous 
playback of the playback section; 
25 Fig. 10 illustrates the internal structure of a 

playback device according to the present invention; 

Fig. 11 illustrates the internal structure of a signal 
output unit 28; 



Fig. 12A illustrates an HD video output signal; 
[0013] 

Fig. 12B illustrates conversion through a 2:3 pull 
down process; 

5 Fig. 13A illustrates the HD video signal output; 

Fig. 13B illustrates conversion into a PAL signal 
through a 50 Hz-DEFT process; 

Fig. 13C illustrates conversion into a PAL signal 
through a 50 Hz-FD process; 
10 Fig. 14A illustrates an HD composite video signal 

output by a compositor 54; 
[0014] 

Fig. 14B illustrates an NTSC composite video signal 
output by a compositor 57; 
15 Figs 15A illustrates an HD composite video signal 

output by the compositor 54; 

Fig. 15B illustrates a PAL composite signal output 
by the compositor 57; 

Fig . 16 is a flowchart of the processing steps performed 
20 by an output controller 51 ; 

Fig. 17 illustrates the internal structure of the 
signal output unit 28 according to a second embodiment of 
the present invention; 

Fig. 18A illustrates the internal structure of BD.CCI 
25 according to a third embodiment of the present invention; 
[0015] 

Fig. 18B illustrates the internal structure of 
CCIforPL; 



Fig. 19 illustrates the functional blocks of a playback 
device according to the third embodiment; 

Fig. 20 illustrates a flowchart of playback processing 
performed by a playback control engine 60; 
5 Fig. 21A illustrates the internal structure of BD.CCI 

according to a fourth embodiment of the present invention; 
[0016] 

Fig. 21B illustrates the internal structure of 
CCIforClip; 

10 Fig. 22 illustrates a flowchart of processing performed 

by the playback control engine 60 according to the fourth 
embodiment; 

Fig. 23A illustrates the internal structure of BD.CCI 
according to a fifth embodiment of the present invention; 
15 [0017] 

Fig. 23B illustrates the internal structure of 
CCIforPlayltem; 

Fig. 24 illustrates a flowchart of processing performed 
by the playback control engine 60 according to the fifth 
20 embodiment; 

Fig. 25 illustrates the internal structure of a 
playback device according to a sixth embodiment of the 
present invention; 

Fig. 26 illustrates the internal structure of CCIforPL 
25 according to a seventh embodiment of the present invention; 

Fig. 27 illustrates an example setting of "CCIforHD 
with CM" and "CCIforHD without CM"; 

Fig. 28 illustrates an example setting of "CCIforSD 



with CM" and "CCIforSD without CM"; 

Fig. 29 illustrates copy restrictions defined with 
the use of additionally provided attributes; 

Fig. 30 illustrates an example of CM content stored 
on a local storage 32; 

Fig. 31A illustrates the structure of a SubClip 
constituting the CM content; 
[0018] 

Fig. 31B illustrates the internal structure of a DSU 
and a DPU included in a text subtitle substream; 

Fig. 32 illustrates the internal structure of PL 
information constituting the CM content; 

Fig. 33 illustrates the internal structure of Playltem 
information illustrated in Fig. 32; 

Fig. 34 illustrates the timeline of PlayList playback 
defined by the PL information stored on the local storage 
32; 

Fig. 35A illustrates an example setting of the DSU 
and the DPU; 
[0019] 

Fig. 35B illustrates the video playback presented by 
sequentially displaying text strings at a specified 
presentation start time and at a specified position on a 
presentation graphics plane 18; 

Fig. 36 illustrates an improvement made on a playback 
device according a seventh embodiment of the present 
invention; 

Fig. 37A illustrates themeaning of values that PSR(23) 

8 



may hold; 
[0020] 

Fig. 37B illustrates an example of setup menu; 
Fig. 38 illustrates a flowchart of setup processing 
5 performed by a setup-menu processing unit 63; 

Fig. 39 is a flowchart of processing performed by the 
playback control engine 60 according to the seventh 
embodiment; 

Fig. 4 0 illustrates a flowchart of processing performed 
10 for synchronous playback of the SubClip with the stream 
playback; 

Fig. 41 illustrates a flowchart of processing performed 
for playback of SubPlayltem #y; 

Fig. 42A illustrates a video sequence presented on 
15 a TV without CM added thereto, and Fig. 42B illustrates 
an SD video signal carrying the video sequence; 

Figs. 43A illustrates a video sequence presented on 
a TV with CM added thereto; 

Fig. 43B illustrates an SD video signal carrying the 
20 video sequence: 

Fig. 4 4 A illustrates the internal structure of CCIforPL 
according to an eighth embodiment of the present invention; 
[0021] 

Fig. 44B illustrates the internal structure of a CM 
25 request that a network device 31 issues for downloading 
the CM content; 

Fig. 45 schematically illustrates acquisition of the 
Disc ID by a CPU 44 (*1), and the transmission of a CM request 

9 



to a WWW server from the network device 31 (*2, and *3); 

Fig. 4 6 schematically illustrates the transmission 
of the CM content and CCI from the WWW server to the playback 

device (*3, *4, and *5); 
5 Fig. 47 illustrates the internal structure of a CM 

request according to a ninth embodiment of the present 
invention; 

Fig. 48 schematically illustrates the acquisition of 
maker information and the Disc ID (*1) as well as the 
10 transmission of the CM request to the WWW server from the 

network device 31 (*2 and *3); 

Fig. 49 illustrates the uses of the maker information; 
Fig. 50 illustrates the application layer format of 
the BD-ROM according to a tenth embodiment; 
15 Fig. 51 illustrates the structure of an AV clip - 

multiplexed with a graphics stream that is used for CM 
presentation; 

Fig. 52A illustrates the content of ODS and PDS carried 
in the graphics stream used for CM presentation; 
20 [0022] 

Fig. 52B illustrates CCIforClip that is unique to the 
AV clip; and 

Fig . 53 illustrates a flowchart of processing performed 
by the playback control engine 60 according to an eleventh 
25 embodiment of the present invention. 

Best Mode for Carrying Out the Invention 
[0023] 

10 



(FIRST EMBODIMENT) 

The following describes an embodiment of a recording 
medium according to the present invention. First of all, 
among various acts of practicing the recording medium of 
5 the present invention, an act of using is described. Fig. 
1 illustrates a form of using the recording medium according 
to the present invention. In Fig. 1, a BD-ROM 100 is the 
recording medium according to the present invention. The 
BD-ROM 100 is used to supply copyrighted material to a home 
10 theater system composed of a playback device 200, a remote 
controller 300, an SDTV 400, an HDTV 500, and a recording 
device 600. 
[0024] 

The playback device 200 is used to play back a movie 
15 recorded on the BD-ROM. More specifically, the playback 
device 200 decodes elementary streams . (video, PG, and IG 
streams) carrying the movie recorded on the BD-ROM to output 
a video signal obtained by the decoding. The video signal 
may be an SD video signal or an HD video signal . The playback 
20 device has a composite terminal, analog output terminals, 
such as D3, D4 , and D5, and a digital output terminal, such 
as HDMI . Via those terminals, the playback device is 
connected to the SDTV 400 and HDTV 500. The video signal 
output to the HDTV is also output to the recording device 
25 600. 

[0025] 

The recording device 600 is used to record SD and HD 
video signals output from the playback device. The 



recording is carried out by receiving and encoding the SD 
and HD video signals and recording the encoded signals on 
a portable recording medium, such as BD-RE, DVD-RAM, DVD-R, 
DVD+R, SD card, and removable HDD . In order that the 
recording device is permitted to record the video signal, 
the following requirement needs to be met. That is, copy 
generation management information, such as CGMS or any other 
form of information, embedded in the SD and HD video signals 
indicates that recording of the content is permitted. In 
the case where CGMS is set to the "Never Copy" status 
prohibiting any recording, the recording device 600 does 
not perform the recording operation described above. If 
the CGMS is set to the "Only One Copy" status, recording 
of the movie is permit ted but no further generation of copying 
is possible. If the CGMS is set to "Copy Free" status, 
a copy of the content recorded on the potable media can 
be copied for unlimited number of times. 
[0026] 

Next, the following describes an act of manufacturing 
the recording media according to the present invention. 
Fig. 2 illustrates the structure of the BD-ROM that is the 
recording media according to the present invention. In 
the figure, the BD-ROM is illustrated on the fourth level, 
and the track of the BD-ROM is illustrated on the third 
level. In the figure, the track is laterally stretched 
out, although the track in practice spirals outwards from 
the center of the BD-ROM . The track is composed of a lead-in 
area, a volume area, and a lead-out area. The volume area 
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has a layer model of a physical layer, a file system layer, 
and an application layer. Data on the application layer 
constitutes the movie and is encrypted. A decryption key 
for decrypting the encrypted data is generated from a Disc 

5 ID and BD.MKB recorded in the lead-in area that is not 
copiable by users. Yet, any detailed description thereof 
is not given here. Since the data on the application layer 
is encrypted using a key stored on the lead-in area, 
unauthorized copying of the data on the BD-ROM to another 

10 recording medium will be of no use. 
[0027] 

Fig. 3 illustrates the application layer format 
(application format) of the BD-ROM expressed using a 
directory structure. Fig. 3 illustrates the structure of 

15 the application layer of the recording medium according 
to the present invention. As illustrated in the figure, 
the BD-ROM has a Root directory, and the Root directly has 
a BDMV directory. 

The BDMV directory stores a file with the extension 

20 "CCI" (a file called "BD.CCI"). In addition, the BDMV 
directory has three subdirectories called "PLAYLIST" , 
"CLIPINF", and "STREAM" . 
[0028] 

The PLAYLIST directory stores files with the extension 
25 "mpls" (files called "00001 . MPLS" , "00002 . MPLS" , and 
"00003. MPLS") . 

The CLIPINF directory stores files with the extension 
"CLIP" (files called "00001 . CLPI", "00002 . CLPI", and 



"00003. CLPI") . 

The STREAM directory stores files with the extension 
"M2TS" (files called "0000 1 . M2TS" , "00002 .M2TS", and 
"00003. M2TS") . 
5 [0029] 

The following sequentially describes files stored in 
each directory. 

<Internal Structure of BD.CCI> 

10 Fig. 4A illustrates the internal structure of BD.CCI. 

The BD-CCI contains information indicating, for each of 
a plurality of image quality levels, whether it is permitted 
to record a video signal output for playback at a respective 
image quality level. As illustrated in the figure, the 

15 BD-CCI includes CCIforHD defining a copy restriction of 
an HD video signal output and CCIforSD defining a copy 
restriction on an SD video signal output. Fig. 4B 
illustrates one possible setting of CCIforHD. 
[0030] 

20 The CCIforHD is set to indicate one of the following 

statuses: "Copy Free", "Only One Copy", "Never Copy", and 
"EPN Copy Free". 

The "Copy Free" status indicates that it is permitted 
to record an HD video signal on a portable recording medium 
25 and also permitted to freely copy the recorded content. 

The "Only One Copy" status indicates that it is 
permitted to record an HD video signal on a portable recording 
medium. However, no further copyingof the recorded content 



is permitted since the CCI is changed to indicate the "No 
More Copy" status upon the recording. 
[0031] 

The "Never Copy" status indicates that recording of 
5 an HD video signal is totally prohibited. 

The "EPN Copy Free (Copy Free + Encryption Plus 
Non-Assertion)" status indicates that it is permitted to 
freely copy an HD video signal on condition that encryption 
is applied. The encryption is applied in a manner that 
10 the content is decryptable only within a single home network. 
Since such encryption is required, the content is protected 
from unauthorized distribution via the Internet, while 
ensuring user' s right to freely use the content within the 
home network . 
15 [0032] 

Similarly to the CCIforHD, the CCIforSD is set to 
indicate one of the following statuses: "Copy Free", "Only 
One Copy", "Never Copy", and "EPN Copy Free". 

Since the CCIforSD is provided separately from the 
20 CCIforHD, different levels of restrictions can be imposed 
on output signals of the playback device, depending on 
whether the signals are HD or SD signals. 
[0033] 

Fig. 4C illustrates an example in which different 
25 levels of restrictions are imposed on recording of the 
respective levels of video signals. The copy control 
illustrated in the figure is such that an HD video signal 
is bound to the Never Copy status and an SD signal is bound 



to the Only One Copy status . Thus, it is permitted to record 
playback of the BD-ROM, provided that the playback device 
outputs the SD video signal. In this example, CCIforBD 
is set to indicate a relatively flexible copy restriction 
5 with CCIforSD set to the Only One Copy status. Yet, this 
is simply an example, and the CCIforSD may be set to the 
EPN Copy Free status. 
[0034] 

This concludes the description of the BD.CCI. 

10 

<Structure of AV Clip> 

Next, a description is given of files with the extension 
" . M2TS" (files called "00001 . M2TS", "00002 .M2TS", 
"00003 .M2TS", ...) . Fig. 5 schematically illustrates the 

15 structure of a file with the extension ".M2TS". Each file 
with the extension " . M2TS" contains an AV clip. The AV 
clip ( illustrated on the middle level ) is created as follows . 
A video stream containing a plurality of video frames 
(pictures pjl, pj2, pj3, ...) and an audio stream containing 

20 a plurality of audio frames (both illustrated on the first 
level) are separately converted to PES packets (illustrated 
on the second level) , and further converted to TS packets 
(illustrated on the third level). Similarly, a 
presentation graphics stream ( hereinafter "PG stream" ) for 

25 presenting subtitles and an interactive graphics stream 
(hereinafter "IG stream") for presenting interactive 
composition (both illustrated on the first level from the 
bottom) are converted into PES packets (illustrated on the 



second level from the bottom) and further into TS packets 
(illustrated on the third level from the bottom) . These 
TS packets of the video, audio, PG, and IG streams are 
multiplexed to form the AV clip. 
5 [0035] 

Before the AV clip is recorded onto the BD-ROM, an 
extension header is attached to each TS packet multiplexed 
in the AV clip. The extension header is 4-byte data called 
"TP_extra_header" and contains "arrival_time_stamp" and 

10 "copy_permission_indicator" . The TS packets each 

attached with a TP_extra_header are divided into groups 
of 32 packets, and each group of packets is recorded into 
three sectors of the BD-ROM track.. The size of one group 
composed of 32 packets with headers amounts to 6,144 (= 

15 32 x 192) bytes, which is equal to the total size of three 
sectors (= 2048 * 3) . Each group of 32 TS packets with 
headers stored in three sectors of the BD-ROM track is 
referred to as an "Aligned Unit". 
[0036] 

20 This concludes the description of AV clips . Apart from 

the above-described AV clip composed of a plurality of 
elementary streams as described above, there is an AV clip 
composed of an elementary stream to be played back in 
synchronism with another elementary stream. Such an AV 

25 clip is referred to as a SubClip. For example, a SubClip 
may be a file containing only one of IG stream, an audio 
stream, and a text subtitle stream. This concludes the 
description of the internal structure of the AV clip. Next, 



individual elementary streams multiplexed in AV clips are 
sequentially described. 

[0037] 
5 <Video Stream> 

A video stream is an elementary stream generated by 
encoding video material into an MPEG2-Video format. 

There are different types of video material, such as 
"f ilm-basedmaterial", "NTSCmaterial" , and " PALmaterial" , 
10 depending on the frame interval and the resolution. 
[0038] 

The "film-based material" refers to video of which 
frame interval is 3750 (alternatively 3753 or 3754) clocks 
in time accuracy of 90, 000 Hz . The resolution of each frame 

15 is typically 1920 x 1080, 1440 x 1080, or 1280 x 720. A 
video stream generated from film-based material of 24 Hz 
is provided with PTS values set at the 3750-clock intervals . 
Similarly, a video stream carrying film-based material of 
24 Hz is provided with PTS values at 3750-clock intervals. 

20 Similarly, a video stream carrying film-based material of 
23 . 97 6 Hz is provided with PTS values at 37 53- or 37 5 4 -clock 
intervals . 
[0039] 

The "NTSC material" refers to video of which frame 
25 interval is 1501 clocks (or 1502 clocks) . The resolution 
of each frame is typically 720 x 480 or 704 x 480. A video 
stream generated from NTSC material is provided with PTS 
values set at the 1501-clock (or 1502-clock) intervals. 

18 



The "PAL material" refers to video of which frame 
interval is 1800 clocks. The resolution of each frame is 
typically 720 * 576 or 704 * 576. A video stream generated 
from PAL material is provided with PTS values set at the 
5 1800-clock intervals. This concludes the description of 
video streams. 
[0040] 

Because of its resolution, film-based material is 
generally referred toas HDmaterial . Inaddition, material 

10 having the same frequency as that of NTSC or PAL may be 
referred to as HD material if the resolution is 1280 x 720 
or higher. On the other hand, NTSC and PAL material is 
often referred to as SD material. Video signals 
representing HD material is what is referred to as an HD 

15 video signal above, whereas video signals representing NTSC 
or PAD material is what is referred to as an SD video signal 
above . 

<Audio Stream> 

20 An audio stream is digital audio data encoded using 

the Dolby-AC3 or Linear-PCM codec. 

[0041] 

<PG Stream> 

25 A PG stream is a graphics stream carrying graphics 

data used for presenting subtitles in a specific language. 
There is a plurality of PG streams for a plurality of 
languages, such as English, Japanese, and French. A PG 
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stream is composed of a sequence of functional segments, 
namely PCS (Presentation Control Segment), PDS (Pallet 
Definition Segment) , WDS (Window Definition Segment) , ODS 

(Object Definition Segment), and END (END of Display Set 
5 Segment) . The ODS defines a graphics object used for 
presenting text subtitles. 

[0042] 

The WDS defines a rendering area for the display of 
graphics data on a screen. The PDS defines output colors 

10 for rendering the graphics object. The PCS defines page 
control for presentation of text subtitles. The page 
control includes Cut-In/Out, Fade-In/Out, Color Change, 
Scroll, and Wipe-In/Out. Under the page control defined 
by the PCS, it is possible to realize such a display effect 

15 that a set of text subtitles gradually disappears, while 
the next set of text subtitles starting to appear on the 
screen . 
[0043] 

A description of PG streams is found for example in 
20 the following PCT publication: WO 2004/068854 Al . 

<IG Stream> 

An IG stream is a graphics stream used for implementing 
interactive control. The interactive control defined by 
25 an IG stream is compatible with interactive control 
performed by a DVD playback device . An IG stream is composed 
of a sequence of functional segments, namely ICS 
(Interactive Control Segment), PDS (Pallet Definition 

20 



Segment), ODS (Object Definition Segment), and END (END 
of Display Set Segment) . The ODS defines a graphics object. 
A plurality of such graphics objects is used to render a 
button presented on an interactive display. The PDS defines 
5 output colors for rendering the graphics ob j ects . The ICS 
defines control for changing the button state in response 
to a user operation. The ICs includes a button command 
to be executed upon receipt of a user operation for activating 
the button. 
10 [0044] 

A description of IG streams is found for example in 
the following PCT publication No. WO 2004/098193 A2 . 

This concludes the description of Main Clips. Next, 
a description of SubClips will be given . A SubClip contains 
15 a digital stream to be played back in synchronism with a 
Main Clip. Examples of such a digital stream include an 
audio stream, a graphics stream, and a text subtitle stream. 
This concludes the description of elementary streams. 

20 <Clip Information> 

Next, the following describes files with the extension 
M . CLPI" . Each file with the extension " . CLPI" ( files called 
"00001 .CLPI", "00002. CLPI", " 00003 . CLPI " , ...) containsClip 
information. The clip information is management 

25 information of an individual AV clip. Fig. 6 illustrates 
the internal structure of Clip information. In the figure, 
leader lines indicate that the internal structure of the 
Clip information is illustrated in greater detail. As 



indicated by the leader lines hnl, the clip information 
includes "program information" and "EP_map" . The "EP_map" 
is used to access the address of an I picture. 
[0045] 

5 The "program information" indicates attributes of an 

individual elementary stream multiplexed in the AV clip. 
The attributes include a video attribute, an audio attribute, 
and a graphics attribute. The video attribute includes 
material information indicating whether the video stream 
10 of the associated AV clip is of film-based material, NTSC 
material, or PAL material. 

The "EP_map" is a reference table used for indirect 
referencing to the address of a skip position specified 
by time information. As indicated by leader lines hn5 , 
15 the EP_map is composed of a plurality of entries (Access 
Unit #1 Entry-Access Unit #n Entry) and the number of entries 
(Number) . 
[0046] 

As indicated by leader lines hn6, each entry includes 
20 the playback start time, the address (SPN), and the size 
of the I picture associated with the entry. More 
specifically, the playback start time of the I picture is 
shown by the time stamp attached to the I picture 
(Presentation Time Stamp) . The address of the I picture 
25 is expressed by a serially assigned SPN (Source Packet 
Number) . Note that the file name "XXX.CLPI" contains "XXX" 
that is in common with the name of the AV clip associated 
with the Clip information. In the example illustrated in 



the figure, since the file name of the AV clip is "XXX", 
it is known that the Clip information is associated with 
the AV clip (XXX.M2TS) . This concludes the description 
of Clip information . 
5 [0047] 

Regarding video signal output, the program information 
includes "DC (Down Convert) inf ormation" - The term 
"downconvert" refers to a conversion of HD material into 
an SD video signal. Leader lines hn3 in Fig. 6 indicates 

10 that the internal structure of DC information included in 
Clip information is illustrated in greater detail. As 
indicated by dotted arrows in the figure, the DC information 
includes "DC_Prohibit_Flag" and "DC_PAL" . The 
"DC_Prohibit_Flag" indicates whether it is permitted to 

15 downconvert the associated AV clip. The "DC_PAL" indicates 
a recommended conversion system for downconverting to PAL, 
provided that downconversion is permitted. This concludes 
the description of the Clip information. 

20 <Playlist Information> 

Next, the following describes files with the extension 
" .mpls" (files called "0001 .MPLS", "0002 .MPLS", 
"0003 .MPLS"...) . A file with the extension ".mpls" contains 
playList information. The playalist information defines 

25 a playlist using references to AV Clips . Fig . 7 illustrates 
the structure of PL information. As the leftmost block 
of the figure indicates, the playlist information includes 
"MainPath information" and "SubPath information". 



[0048] 

As indicated by dashed arrows mpl, the MainPath 
information (MainPathO) is composed of a plurality of 
pieces of Playltem information (Playltem () ) . Each piece 

5 of Playltem information defines a playback section by 
specifying In_time and Out_time on one continuous AV Clip 
timeline. With the plurality of pieces of Playltem 
information, a PlayList (hereinafter also referred to as 
"PL") composedof a plurality of playback sections is defined. 

10 In Fig. 7, dashed arrows mp2 indicate that the internal 
structure of Playltem information is illustrated in greater 
detail. As illustrated, the Playltem information is 
composed of the following fields: 

"Clip inf ormation_f ile_name" indicating the name of the 

15 associated AV clip; "In_time"; and "Out_time" . Fig. 8 
illustrates the relationship between the AV clip and the 
PlayList information. The first level illustrates the 
timeline of the AV clip, and the second level illustrates 
the timeline of the PL. The PL information includes 

20 Playltem #1, #2, and #3. The In_time and the Out_time of 
Playltem #1, #2, and #3 define three playback sections. 
A linear sequence of the three playback sections defines 
a timeline that is different from the AV clip timeline. 
This timeline of the three playback sections is the PL 

25 timeline illustrated on the second level in the figure. 
As stated above, by defining the Playltem information, a 
timeline different from the AV clip timeline is defined. 
A playback section of the AV clip defined by the Playltem 



information is referred to as a "MainPath" . 
[0049] 

The SubPath information (SubPathO) defines one 
continuous playback section by specifying In_time and 

5 Out_time on the timeline of the SubClip . Fig . 7 illustrates, 
as leader lines shl indicate, the internal structure of 
SubPath information in detail . As illustrated, the SubPath 
information is composed of a plurality of pieces of 
SubPlayltem information (SubPlayltem ()). Further, as 

10 indicated by leader lines sh2, the SubPlayltem information 
is composed of the following fields: 

"Clip_information_f ile_name", "In_time", "Out__time", 
"sync_PlayItem_id", and "sync_start__PTS_of _PlayI tern" . 
The "Clip_information_f ile_name", "In_time", and 

15 "Out_time" fields define a playback section on the SubClip 
timeline. The "sync_PlayI tem_id" and 

"sync_start_PTS_of_PlayItem" fields define synchronous 
playback of the playback section defined on the SubClip 
timeline with the PL timeline. According to the defined 

20 synchronous playback, playback proceeds synchronously on 
the PL timeline and the Subclip timeline. The playback 
section defined on the SubClip is referred to as "SubPath". 
[0050] 

Fig. 9 illustrates a playback section defined on the 
25 SubClip timeline and playback control defined for 
synchronous playback. In the figure, the first level 
illustrates the PL timeline, and the second level 
illustrates the SubClip timeline. The 



SubPlayltem. In_time and the SubPlayltem. Out_time indicate 
the start point and end point of the playback section, 
respectively. It is thus shown that the playback section 
is defined also on the SubClip timeline. An arrow Snl 

5 indicates that the Sync_PlayI tem_id specifies a Playltem 
to be synchronously played with the playback section. An 
arrow Sn2 indicates that Sync_start_PTS_of _PlayI tern 
specifies a specific point on the Playltem (Playltem #1) 
specified by the Sync_PlayI tem_id . 

10 [0051] 

The playback information on a BD-ROM can define a 
multi-angle section and a synchronous section. During 
playback of a multi-angle section, an angle change is 
possible among a plurality of AV clips. During playback 

15 of a synchronous section, an AV clip and a SubClip are 
synchronously played back. The Clip information and 
Play.List information described above is classified as 
"static scenario", because they define a PL, which is a 
statically defined playback unit. This concludes the 

20 description of the BD-ROM. 
[0052] 

Next, a description of a playback device according 
to the present invention is given. 

25 <Internal Structure of Playback Device> 

Fig. 10 illustrates the internal structure of a 
playback device according to the present invention. Based 
on the internal structure illustrated in the figure, 

26 



playback devices consistent with the present invention are 
industrially manufactured. The playback device of the 
present invention is roughly composed of two parts, one 
of which is a system LSI and the other is a drive device. 
5 By mounting those parts into a device cabinet and onto a 
substrate, the playback device can be manufactured 
industrially. The system LSI is an integrated circuit 
containing various processing units for implementing the 
functions of the playback device. The playback device 

10 manufactured in the above manner is composed of a BD drive 
1, a decryption unit la, an arrival time clock counter 2, 
a source de-packetizer 3, a PID filter 4, a transport buffer 
5, a multiplexed buffer 6, a elementary buffer 7, a video 
decoder 8, a re-order buffer 9, a switch 10, a video plane 

15 11, a transport buffer 12, a coded data buffer 13, a stream 
graphics processor 14, an object buffer 15, a composition 
buffer 16, a composition controller 17, a presentation 
graphics plane 18, a CLUT unit 19, a transport buffer 20, 
a coded data buffer 21, a stream graphics processor 22, 

20 an object buff er 23, a composition buff er 24 , a composition 
controller 25, an interactive graphics plane 26, a CLUT 
unit 27, a signal output unit 28, a switch 29, a network 
device 31, a local storage 32, an arrival time clock counter 
33, a source de-packetizer 34, a PID filter 35, a switch 

25 36, a transport buff er 37 , an elementary buff er 38 , an audio 
decoder 39, a transport buffer 40, a buffer 41, a text 
subtitle decoder 42, a scenario memory 43, a CPU 44, an 
instruction ROM 45, and a PSR set 49 . Note that the internal 



structure illustrated in the figure is a decoder model based 
on the MPEG T-STD model and capable of down-converting. 
[0053] 

The BD drive 1 loads/ejects the BD-ROM and accesses 
5 the BD-ROM to sequentially read Aligned Units each composed 
of 32 TS packets. 

The decryption unit la reads the Disc ID and the BD.MKB 
from the lead-in area, and generates an encryption key. 
The decryption unit la decrypts the AV clip using the thus 
10 generated encryption key, and supplies the decrypted data 
in real time to the source de-packetizer 3. 
[0054] 

The arrival time clock counter 2 generates an arrival 
time clock using a 27 MHz crystal oscillator (27 MHz X-tal) . 

15 The arrival time clock is a clock signal defining the timeline 
on which the ATS assigned to each TS packet is based. 

Once an Aligned Unit composed of 32 TS packets is read 
from the BD-ROM, the source de-packetizer 3 removes the 
TP_extra_header from each of the 32 TS packets and outputs 

20 the TS packets without the headers to the PID filter 4. 
The output by the source de-packetizer 3 to the PID filter 
4 is performed at the timing when the time measured by the 
arrival time clock counter 2 reaches the ATS shown by the 
TP_extra_header . Since the output to the PID filter 4 is 

25 carried out in accordance with the ATS, the TS packets are 
sequentially output to the PID filter 4 in accordance with 
the time measured by the arrival time clock counter 2, 
regardless of the speed at which data is read from the BD-ROM, 



such as lx-speed or 2*-speed. 
[0055] 

The PID filter 4 judges, with reference to the PID 
attached to the TS packets, whether the type of stream to 
5 which the TS packets belong is a video stream, a PG stream, 
or an IG stream. According to the judgment, the PID filter 
4 outputs the TS packets to an appropriate one of the 
transport buffers 5, 12, 20, and 37. 

The transport buffer (TB) 5 is a buffer for temporarily 
10 storing TS packets output from the PID filter 4, if the 
TS packets belong to a video stream. 
[0056] 

The multiplexed buffer (MB) 6 is a buffer for 
temporarily storing PES packets output from the transport 
15 buffer 5, in order to later output the video stream to the 
coded picture buffer 7 . 

The elementary buffer (EB) 7 is a buffer for storing 
a video elementary stream. 
[0057] 

20 The video decoder 8 decodes individual frames contained 

in the video elementary stream at every predetermined 
decoding time (DTS) to obtain a plurality of frames and 
writes the resulting picture data on the re-order buffer 
9. 

25 The re-order buffer 9 is a buffer for storing pictures 

(I picture and P picture) referenced by other pictures. 
[0058] 

The switch 10 performs switching between output from 



the video decoder 8 and output from the re-order buffer 
9, so as to reorder the presentation order of coded data 
obtained by decoding. 

The video plane 11 is used for presenting uncompressed 
5 picture data. A plane is a memory area of the playback 
device for storing a frame of pixel value data. The video 
plane 11 stores picture data at the resolution of 1920 * 
1080 and the picture data is composed of pixel values each 
expressed by 16-bit YUV values. 
10 The transport buff er (TB) 12 is a buff er for temporarily 

storing TS packets output from the PID filter 4, if the 
TS packets belong to a PG stream. 
[0059] 

The coded data buffer (CDB) 13 is a buffer for 
15 temporarily storing PES packets constituting a PG stream. 

The stream graphics processor (SPG) 14 decodes a PES 
packet containing graphics data (ODS ) to obtain uncompressed 
bitmapped data expressed by index colors. The stream 
graphics processor (SPG) 14 then writes the obtained 
20 bitmapped data as a graphics object on the object buffer 
15. 

[0060] 

The object buffer 15 holds the graphics object obtained 
as a result of the decoding performed by the stream graphics 
25 processor 14 . 

The composition buffer 16 is memory for storing control 
information for graphics data rendering (PCS) . 

The composition controller 17 analyzes the PCS stored 



on the composition buffer 16 and executes control in 

accordance with the analytical result. 

[0061] 

The presentation graphic plane 18 is a memory area 
as large as one full screen and stores uncompressed graphics 
data worth one screen. The presentation graphic plane 18 
stores uncompressed graphics data at the resolution of 1920 
x 1080 and pixel values of the uncompressed graphics data 
are expressed using an 8-bit index colors. By converting 
the index colors with reference to a CLUT (Color Lookup 
Table) , the uncompressed graphics data stored on the 
presentation graphics plane 18 is supplied for display. 

The CLUT unit 19 converts the index colors of the 
uncompressed graphics data stored on the presentation 
graphic plane 18 into Y, CR, and Cb values. 
[0062] 

The transport buff er (TB) 2 0 is a buff er for temporarily 
storing TS packets belonging to an IG stream. 

The coded data buffer (CDB) 21 is a buffer for 
temporarily storing PES packets constituting an IG stream. 

The stream graphics processor (SPG) 22 decodes a PES 
packet carrying graphics data to obtain uncompressed 
bitmapped data expressed by index colors, and writes the 
obtained bitmapped data as a graphics object on the object 
buffer 23. 
[0063] 

The ob j ect buffer 23 stores apluralityof uncompressed 
graphics objects obtained as a result of the decoding by 

31 



the stream graphics processor 22. 

The composition buffer 24 is a buffer for storing 
control information for graphics data rendering. 

The composition controller 25 analyzes the PCS stored 
5 on the composition buffer 24 and executes control in 
accordance with the analytical result. 
[0064] 

The interactive graphics plane 26 is used for 
presenting uncompressed graphics data obtained as a result 

10 of the decoding by the stream graphics processor (SGP) 22. 
The uncompressed graphics data is written on the interactive 
graphics plane 26 at the resolution of 1920 x 1080, and 
the graphics data is composed of pixel values each expressed 
using 8-bit index colors. By converting the index colors 

15 with reference to the CLUT (Color Lookup Table), the 
uncompressed graphics data stored on the interactive 
graphics plane 26 is supplied for display. 
[0065] 

The CLUT unit 27 converts the index colors of the 
20 uncompressed graphics data stored on the interactive 
graphics plane 26 into Y, CR, and Cb values. 

The signal output unit 28 captures data from the video 
plane 11, the presentation graphics plane 18, and the 
interactive graphics plane 26 at predetermined time 
25 intervals to generate HD and SD video signals and output 
the resulting signals simultaneously. 
[0066] 

The switch 29 selectively supplies the TS packets read 



from the BD-ROM or the TS packets read from the local storage 
32 to the transport buffer 20. 

The network device 31 is used to implement the 
communications functionality of the playback device . More 
5 specifically, the network device 31 establishes TCP 
connection, FTP connection, and so on, with a web site at 
an URL . 

The local storage 32 is used to store content supplied 
via various recording media and communication media. 
10 Content downloaded from a web site via the connection 
established by the network device 31 is also stored to the 
local storage 32. 
[0067] 

The source de-packetizer 34 removes the 
15 TP_extra_header from each TS packet constituting the AV 
clip read from the local storage 32 and outputs the TS packets 
without headers to the PID filter 35. The output of the 
TS packets to the PID filter 35 is carried out at the timing 
when the time measured by the arrival time clock counter 
20 33 reaches the ATS shown by the TP_extra_header . 
[0068] 

The PID filter 35 performs switching so as to 
selectively output the TSpackets read from the local storage 
32 to an appropriate one of the IG stream decoder, the audio 
25 decoder, and the text subtitle decoder. 

The switch 36 issues a permission request for the TS 
packets read from the BD-ROM or from the local storage 32. 

The transport buffer (TB) 37 stores the TS packets 



belonging to an audio stream. 
[0069] 

The elementary buffer (EB) 38 stores the PES packets 
constituting the audio stream. 
5 The audio decoder 39 decodes the PES packets output 

from the elementary buff er 38 and outputs uncompressed audio 
data obtained by the decoding. 

The transport buffer (TB) 40 stores TS packets 
belonging to a text subtitle stream. 
10 [0070] 

The elementary buffer (EB) 41 stores the PES packets 
carrying the text subtitle stream. 

The text subtitle decoder 42 decodes PES packets read 
to the elementary buffer 41 and supplies the resulting data 

15 for presentation. More specifically, the text subtitle 
decoder 42 expands text strings contained in the text 
subtitle stream into bitmapped data, by applying font data 
separately read from the local storage 32. The resulting 
data is written on the presentation graphics plane 18. 

20 [0071] 

The scenario memory 43 stores current PlayList 
information and current Clip information. The current 
PlayList information used herein refers to the currently 
processed PlayList information from among a plurality of 
25 pieces of PlayList information stored on the BD-ROM. The 
current Clip information used herein refers to the currently 
processed Clip information from among a plurality of pieces 
of Clip information stored on the BD-ROM. 



The CPU executes software stored on the instruction 
ROM 45 to carry out overall control of the playback device. 
The control executed on the playback device dynamically 
changes in response to a user event generated upon receipt 
5 of a user operation and in accordance with the values held 
in the PSRs of the PSR set 49. 
[0072] 

The instruction ROM 45 stores software defining 
playback control of the playback device. 

10 The PSR set 4 9 is a set registers provided within the 

playback device. The set of registers include 64 player 
status registers (PSRs) and 4 , 096 general-purpose registers 
(GPRs) . The 64 player status registers represent the 
current status of the playback device, including the current 

15 playback point . The current playback point is represented 
by the values of the PSR ( 5 ) -PSR ( 8 ) . Specifically, the 
PRS(8) takes on a value ranging from 0 to OxFFFFFFFF 
representing the current playback point (current PTM) on 
the AV clip in 45 KHz time accuracy. The PSR (11 ) represents 

20 the page_id of the currently active page (current page) 
constituting a multi-page menu. The PSR (10) represents 
the button in the selected state ( current button) presented 
on the current page . 



25 [0073] 

<Internal Structure of Signal Output Unit 28> 

This concludes the description of the internal 
structure of the playback device. Next, a description of 
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the internal structure of the signal output unit 28 is given 
in greater detail- Fig, 11 illustrates the internal 
structure of the signal output unit 28. As illustrated 
in the figure, the signal output unit 28 is composed of 
5 an output controller 51, an up-converters 52a, 52b, and 
52c, a compositors 53 and 54, a down-converters 55a, 55b, 
and 55c, and compositors 56 and 57. 
[0074] 

The output controller 51 captures the data presented 
10 on the video plane 11, the presentation graphics plane 18, 
and the interactive graphics plane 26 at predetermined time 
intervals, and overlays the captured plane images on one 
another to make final video output at the adjusted display 
rate. Fig. 12A illustrates the HD video signal output. 
15 In the figure, frame images P1-P7 represent individual 
pictures constituting the HD video. The output controller 
51 outputs those frame images at 1/24 sec intervals. As 
a result, a progressive HD video signal is output at 1/24 
Hz. 
20 [0075] 

Other than the above process, the display rate may 
be adjusted through 2:3 pull down, 50Hz-DEFT, or 50Hz-FD. 
The "display rate adjustment" used herein refers to the 
process of displaying video, for example, film-based 
25 material having a 24 Hz or 23.976 Hz display rate at a 
different display rate. Fig. 12B illustrates the 2:3 pull 
down conversion. In the figure, the frame images P1-P7 
are individual pictures constituting film-based material . 



By applying the 2:3 pull down, the film-based material is 
converted into the following five fields: Plt-Plb (the top 
and bottom fields of PI) , P2t-P2b (the top and bottom fields 
of P2) , and P2t (the top field of P2 ) . The output controller 
5 51 outputs those frame fields at 1/59.94 sec intervals. 
As a result, the video signal is output at the display 
intervals compliant with the NTSC. 
[0076] 

Fig. 13A illustrates the HD video output signal. Fig. 

10 13B illustrates conversion into PAL signal through the 50 
Hz-DEFT process. 50Hz-DEFT is a process of converting 24 
Hz video into 25 HZ. In other words, it is a process of 
fast-forwarding the video. More specifically, the 
conversion process is carried out by outputting the top 

15 and bottom fields of each picture at the intervals of 1/50 
sec. In Fig. 13A, frame images P1-P3 are individual 
pictures constituting film-based material. By applying 
the 50 Hz-DEFT conversion to the images P1-P3, the following 
six fields are output: Plt-Plb (the top and bottom fields 

20 of PI) ; P2t-P2b (the top and bottom fields of P2 ) ; andP3t-P3b 
(the top and bottom fields of P3) . The output controller 
51 outputs those fields at 1/50 sec intervals. As a result, 
the film-based material is output as a video signal having 
display intervals compliant with the PAL. The 50 Hz-DEFT 

25 conversion is advantageous in that flame fluctuations are 
minimized. Yet, the 50-HZ DEFT involves disadvantage that 
audio playback rate needs to be increased with the video 
playback rate, which leads to audio distort ion (highpitch) . 



Due to the disadvantage, the 50 Hz DEFT is not suitable 
for applications that place importance on music. 
[0077] 

Fig. 13C illustrates the conversion into a PAL signal 

5 through 50 Hz-FD . In the 50 Hz-FD (Field Dubbing) process, 
fields are duplicated (field dubbing) at regular intervals 
to slower the playback rate in order to minimize audio 
distortion. For example, one out of every five frames is 
dabbled (i.e., two fields per second). In Fig. 13A, the 

10 flame images P1-P5 are individual pictures constituting 
film-based material . The frames P1-P5 are converted into 
the following ten fields: Plt-Pln, P2t-P2n, P3t-P3b, 
P4t-P4b, and P5t-P5b. In the 50Hz-FD process, the field 
P5t is subject to field dubbing. As a result of the field 

15 dubbing, the field p5t is output in duplicate, so that the 
video playback rate is reduced and maintained at the equal 
speed. In view of this, the 50 Hz FD is more suitable for 
applications that place importance on equal speed playback . 
This concludes the description of the output controller 

20 51 . 

[0078] 

For playback of a video stream of SD material, the 
up-converter (V-UC) 52a modifies the resolution of the 
uncompressed frame image data stored on the video plane 
25 11 by enlarging the frame image data in the horizontal and 
vertical directions. For playback of a video stream of 
HD material, the up-converter 52a does not apply any 
conversion but simply passes, as its output, the 



uncompressed frame image data stored on the video plane 
11. The resolution of SD material is 720 * 480, whereas 
the resolution of HDTV is 1920 * 1080. Thus, the rescaling 
rate in the horizontal direction is 1920 pixels/720 pixels 

5 * 2 . 67 , whereas the rescaling rate in the vertical direction 
is 1080 pixels/480 pixels = 2.25. In the process of 
up-conversion, an original frame image is enraged according 
to the rescaling ratios and the pixel aspect ratio (the 
length-to-width ratio of each pixel) . 

10 [0079] 

For playback of a PG stream of SD material, the 
up-converter (PG-UC) 52b modifies the resolution of 
uncompressed graphics data stored on the presentation 
graphics plane 18 by enlarging in vertical and horizontal 

15' directions. For playback of a PG stream of HD material, 
the up-converter 52bdoesnot apply any conversion but simply 
passes, as its output, the graphics data stored on the 
presentation graphics plane 18. The rescaling ratios in 
the horizontal and vertical directions of SD material are 

20 calculated in the same manner as that used by the up-converter 
52a. 
[0080] 

For playback of an IG stream of SD material, the 
up-converter (IG-UC) 52c modifies the resolution of 
25 uncompressed graphics data stored on the interactive 
graphics plane 2 6, by enlarging the graphics data in vertical 
and horizontal directions. For playback of an IG stream 
of HD material, the up-converter 52c does not apply any 



conversion but simply passes , as its output , the frame image 
stored on the interactive graphics plane 26 . The rescaling 
ratios in the horizontal and vertical directions of SD 
material are calculated in the same manner as that used 
5 by the up-converter 52a. 
[0081] 

The compositor 53 carries out signal composition during 
the frame intervals of HD video signal . More specifically, 
the compositor 53 overlays the uncompressed frame image 

10 stored on the video plane 11 with the uncompressed graphics 
object sorted on the presentation graphics plane 18 to make 
an interim composite image . In the interim composite image 
obtained as a result of the composition, the text subtitles 
are overlaid on the video. 

15 [0082] 

The compositor 54 carries out signal composition during 
(i) the frame intervals and (ii) vertical blanking intervals 
(VBI) of an HD video signal. More specifically, during 
(i) the frame intervals, the compositor 54 overlays the 
20 uncompressed graphics object stored on the interactive 
graphics plane 26 with the interim composite image (of the 
uncompressed picture data overlaid with the uncompressed 
graphics obj ect stored on the presentation plane 18 ) output 
from the compositor 53. During (ii) the vertical blanking 
25 period, CGMS is embedded into vertical blanking intervals 
of the HD video signal. The CGMS is obtained by converting 
CCIforHD contained in CCIforBD. As a result of the 
processing by the compositor 54 , the HD video signal carries 



a composite image of video + subtitles + a menu in the frame 
intervals, and also carries CGMS generated from CCIforHD 
in the vertical blanking intervals . In the future, transfer 
of the. video signal may be carried out via a digital I/F 

5 such as HDMI . In such a case, the copy control information 
(CGMS) may be transferred using a different scheme than 
the analog transfer scheme. Still, what is required for 
adapting such a feature technology is to simply replace 
the signal composition process during (ii) the vertical 

10 blanking periods with a scheme capable of transferring the 
copy generation management via a digital I/F. 
[0083] 

The down-converter (V-DC) 55a modifies the resolution 
of an uncompressed frame image stored on the video plane 

15 11 by reducing the frame image in the vertical and horizontal 
directions. Yet, in the case where the target video stream 
is of SD material, the down-converter 55a does not apply 
any conversion but simply passes, as its output, the frame 
image stored on the video plane 11 . The resolution of HDTV 

20 is 1920 * 1080, whereas the resolution of SDTV is 720 * 
480. Thus, the rescaling rate in the horizontal direction 
is 720 pixels/1920 pixels = 0.375, whereas the rescaling 
rate in the vertical direction is 480 pixels/1080 pixels 
* 0.444. In the process of down-conversion, an original 

25 frame image is reduced according to the rescaling ratios 
and the pixel aspect ratio (the length-to-width ratio of 
each pixel) . 
[0084] 



The down-converter (PG-DC) 55b modifies the resolution 
of uncompressed graphics data stored on the presentation 
graphics plane 18 by reducing the graphics data in the 
vertical and horizontal directions . Yet, in the case where 
a target PG stream is of SD material, the down-converter 
55b does not apply any conversion but simply passes, as 
its output, the frame image stored on the presentation 
graphics plane 18. The rescaling ratios in the horizontal 
and vertical directions of HD material are calculated in 
the same manner as that used by the down-converter 55a. 
[0085] 

The down-converter (IG-DC) 55c modifies the resolution 
of uncompressed graphics data stored on the interactive 
graphics plane 26 . Yet, in the case where a target IG stream 
is of SD material, the down-converter 55c does not apply 
any conversion but simply passes, as its output, the frame 
image stored on the interactive graphics plane 26. The 
rescaling ratios in the horizontal and vertical directions 
of HD material are calculated in the same manner as that 
used by the down-converter 55a. 
[0086] 

The compositor 56 carries out signal composition during 
the field intervals of an SD video signal. More 
specifically, during the field intervals, the compositor 
56 overlays the top or bottom field of the frame image stored 
on the video plane with a corresponding one of top and bottom 
fields of the uncompressed object stored on the presentation 
graphics plane 18 to make an interim composite image. In 
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the interim composite image obtained as a result of the 
composition by the compositor 56, the text subtitles are 
overlaid on the video. 
[0087] 

5 The compositor 57 carries out signal composition during 

(i) the field intervals and (ii) vertical blanking period 
of an SD video signal. More specifically, during (i) the 
field intervals, the compositor 57 overlays the top or bottom 
field of the uncompressed graphics object stored on the 

10 interactive graphics plane 26 with a corresponding one of 
top and bottom fields of the interim composite image (of 
the uncompressed picture data overlaid with the 
uncompressed graphics object stored on the presentation 
plane 18) output from the compositor 56. During (ii) the 

15 vertical blanking period, CGMS is embedded into vertical 
blanking intervals of the SD video signal. The CGMS is 
obtained by converting CCIforSD contained in CCIforBD. As 
a result of the processing by the compositor 57, the SD 
video signal carries a composite image of video + subtitles 

20 + a menu in the frame intervals, and also carries CGMS 
generated from CCIf orHD in the vertical blanking intervals . 
In the future, transfer of the video signal may be carried 
out via a digital I/F such as HDMI . In such a case, the 
copy control information (CGMS) may be transferred using 

25 a different scheme than the analog transfer scheme . Still , 
what is required for adapting such a feature technology 
is to simply replace the signal composition process during 
(ii) the vertical blanking periods with a scheme capable 



of transferring the copy generation management via a digital 
I/F. The scope of the term "assign" used in this 
specification is relatively broad and covers "embedding" 
CGMS in the vertical blanking periods of a video signal, 
5 as described above . 

<Details of HD and SD Video Signals> 

Fig. 14A illustrates an HD composite video signal 
output from the compositor 54 . As illustrated in the figure, 

10 the HD video signal is composed of alternating "frame 
intervals" and "vertical blanking intervals" . The HD video 
signal carries frame images PI, P2, P3, P4, ... captured from 
the output controller 51 in the frame intervals. The CGMS 
embedded by the compositor 54 is carried in the vertical 

15 blanking intervals . Since the CGMS embedded in the vertical 
blanking intervals indicate "Copy Never", even if the 
recording device 600 is connected to the playback device, 
the recording device 600 is not permitted to record this 
HD video signal to a portable recording medium such as a 

20 DVD . 

[0088] 

Fig. 14B illustrates an SD composite video signal 
output in compliance with NTSC by the compositor 57. As 
illustrated in the figure, the SD video signal is composed 
25 of alternating "field intervals" and "vertical blanking 
intervals". The field images Pit, Plb, P2t, P2b, P3t, P3b, 
P4t, P4b ... captured from the video plane 11 are carried 
in the field intervals . The CGMS embedded by the compositor 



57 is carried in the vertical blanking intervals. Since 
the CGMS embedded in the vertical blanking intervals 
indicate "Only One Copy", the recording device 600 is only 
permitted to make a first generation copy of the video signal 
5 onto a portable recording medium such as a DVD. Figs. 14A 
and 14B illustrate an example of NTSC signal, whereas Figs 
15A and 15B illustrate an example of PAL signal. 
[0089] 

The above description relates, but not limited, to 
10 an example of BD.CCI defining a relatively flexible 
restriction, with CCIforHD set to "Copy Never" and CCIf orSD 
set to "Only Once Copy". Alternatively, CCIforHD may be 
set to "Copy Never" and CCIforSD may be set to EPN-Copy 
Free . 

15 Now, a specific description is given of implementation 

of the output controller 51. The output controller 51 may 
be implemented as a system LSI circuit containing a CPU 
and a program defining processing steps illustrated in Fig . 
16. Fig. 16 is a flowchart of the processing steps performed 

20 by the output controller 51. According to the flowchart, 
the output controller 51 judges, with reference to the Clip 
information, whether the resolution of the video stream 
contained in the AV clip is egual to 1920 x 1080 (Step SI) . 
According to the judgment result, either the sequence of 

25 Steps S2-S15 or the sequence of Steps S16-20 is selectively 
performed . 
[0090] 

Through the processing steps S2-S15, CCIforHD is 
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converted into CGMS in a format suitable for the transmission 
path of video (step S2) . In the case of analog output, 
for example, CCIforHD is converted into CGMS-A. The CGMS 
is embedded into the HD video signal and the resulting signal 
5 is output for playback (step S3). Then, the SD video signal 
is output for playback (steps S4-S15) . 
[0091] 

At the time of the SD video signal output (steps S4-S15 ) , 
the output controller 51 refers to the DC_prohibit_f lag 

10 included in the Clip information (step S4). If the 
DC_prohibit_f lag is set to "1" (step S4 : NO) , the processing 
is terminated without performing any further steps. On 
the other hand, if the DC_prohibi t_f lag is set to w 0" (step 
S4 : YES), the step S5 is performed next. 

15 In the step S5, it is judged whether the SD video signal 

is in the NTSC system or the PAL system. If the SD video 
signal is in the NTSC system, the down-converters 55a, 55b, 
and 55c are activated (step S6) , and CCIforSD is converted 
into CGMS (step S7) . While instructing the compositor 54 

20 to embed the CGMS into the NTSC signal , the output controller 
51 causes output of the NTSC signal to be started (step 
S8) . 
[0092] 

If it is judged in the step S5 that the SD video signal 
25 is in the PAL system, a step S9 is performed next. In the 
step S9, it is judged whether the DC_PAL in the Clip 
information is set to either of "10" and "ll". If it is 
set to either of "10" and "11" (step S9: YES), the output 



controller 51 activates the up-converters 52a, 52b, and 
52c (step S10) . At the same time, the output controller 
51 converts CCIfroSD into CGMS (step Sll) . While 
instructing the compositor 57 to embed the resulting CGMS 
5 to the SD signal, the output controller 51 executes the 
50Hz-FD process . As a result, output of the SD video signal 
starts (step S12) . 
[0093] 

If, on the other hand, the DC_PAL in the Clip information 
10 is set to neither of "10" nor "11", the output controller 
51 activates the down-converters 55a, 55b, and 55c (step 
S13), and converts CCIforSD to CGMS (step S14). While 
instructing the compositor 57 to embed the resulting GGMS 
to the SD signal, the output controller 51 executes the 
15 50 Hz-DEFT processes to start SD video signal output (step 
S15) . 

If the video stream is judged to be of SD material 
(step SI: NO), the output controller 51 causes CCIforSD 
to be converted into CGMS (step SI 9) . The output controller 

20 51 then causes the resulting CGMS to be embed into the SD 
video and the resulting SD signal to be output (step S20) . 
In the case where the SD material is up-converted to be 
output as an HD video signal, the copy generation management 
information to be embedded in the video signal may be any 

25 of CCIforHD and CCIforSD. 
[0094] 

As described above, according to the present embodiment, 
copy control may be set so as to prohibit recording of an 



HD video signal but to permit recording of an SD video signal . 
Since recording of an SD video signal is permitted, users 
are allowed to readily obtain a copy of a movie recorded 
at the SD level, simply by connecting the output terminal 

5 of the playback device to the input terminal of the recording 
device. As described above, since a copy of a certain 
quality level is readily available to users, simply by 
connecting the recording device 600 to the playback device . 
Thus, the users are discouraged to go through the troubles 

10 of obtaining rippers and make illegal copies. As a 
consequence, illegal copying by users is expected to be 
reduced . 

[0095] 

15 (SECOND EMBODIMENT) 

The first embodiment of the present invention mainly 
relates to the case where the playback device is connected 
to the TV via analog connection, A second embodiment of 
the present invention relates to the case where the playback 

20 device is connected to. an HDTV via digital connection. 

The interface used for establishing digital connection 
is, for example, the one called HDMI (High Definition 
Multimedia Interface ) . According to the second embodiment, 
the signal output unit 2 8 is provided therein with a connector 

25 for HDMI connection. 
[0096] 

Fig. 17 illustrates the internal structure of the 
signal output unit 28 according to the second embodiment. 



The reference numerals each associated with an asterisk 
(*1, *2, *3, and *4) represent processes performed by the 
signal output unit 28 for establishing digital connection. 
As illustrated in the figure, the signal output unit 28 

5 includes an HDMI connector 58 for establishing digital 
connection with the HDTV . In addition, the HDTV is provided 
with a component (HDMI connector 59) similar to the HDMI 
connector 58, The HDMI connector 58 carries out mutual 
authentication (*1), negotiates the output mode (*2), and 

10 then transfers uncompressed video data (*3) and CCI (*4) 
in compliance with the copyright protection system called 
HDCP. 
[0097] 

For transmitting CCI, the HDMI connector 58 passes 
15 either of the CCIforHD and CCIforSD depending on the type 
of material or the type of video signal carried on the 
transmission path. The type of video signal refers to 
either an HD or SD video signal . The type of material refers 
to either HD or SD video material. With the above 
20 arrangement, the playback device is allowed to output a 
video signal via a digital I/F together with appropriate 
CCI. In the case of transferring an uncompressed video 
stream, the playback device transfers the uncompressed 
video stream with an appropriate one of CCIforHD and CCIforSD. 
25 The scope of the term "assign" used in this specification 
is relatively broad and covers "output CGMS with 
uncompressed video stream". 
[0098] 



The digital I/F is not limited to HDMI and may 
alternatively be any other interface including IEEE1394, 
USB, and IP network. In addition, the copyright protection 
system is not limited to HDCP and may alternatively be any 
5 other system including DTCP and Net DRM . In practice, video 
signals and CCI are transmitted in the mode suitable to 
the I/F and copyright protection system employed. Yet, 
it still holds, regardless of whether a digital I/F or an 
analog I/F is employed, that appropriate CCI (restrictions 
10 imposed on recording) is selectably assigned in accordance 
with the type of the video signal and/or the material. 

[0099] 

(THIRD EMBODIMENT) 

15 According to the first embodiment above, a single piece 

of CCI is assigned to the entire BD-ROM. A third embodiment 
of the present invention relates to an improvement in which 
different pieces of CCI are assigned to different pieces 
of PL information. Fig. 18A illustrates the internal 

20 structure of BD.CCI according to the third embodiment. 

As illustrated in the figure, the BD.CCI is composed 
of CCIforPL #1-#N. Each piece of CCIforPL defines copy 
control to be effected on SD and HD video signals output 
at the time of playback of a specific piece of PL information. 

25 Fig. 18B illustrates the internal structure of a piece of 
CCIforPL. As illustrated in the figure, CCIforPL is 
composed of CCIforHD and CCIforSD. 
[0100] 



This concludes the description of the improvement on 
the recording medium according to the third embodiment. 
Now, the following describes an improvement made on the 
playback device . Fig . 19 illustrates the functional blocks 
5 of a playback device according to the third embodiment. 

As illustrated in the figure, the playback device 
includes a functional block called a playback control engine 
60 implemented by the CPU and a control program stored on 
the instruction ROM. 
10 The playback control engine 60 executes playback 

control according to PL information stored on the scenario 
memory . 
[0101] 

By using CCIforPL that is additionally provided in 
15 the third embodiment, the playback control engine 60 
performs the processing steps illustrated in Fig. 20. The 
processing steps S101-S110 illustrated in Fig. 20 are 
processing steps common to other embodiments, whereas the 
steps Sill and S112 are unique to the third embodiment. 
20 Hereinafter, the processing steps performed by the 

playback control engine 60 are specifically described with 
reference to the flowchart illustrated in Fig. 20. 
[0102] 

Fig. 20 illustrates the flowchart of the playback 
25 processing performed by the playback control engine 60. 
The playback processing mainly includes a step of 
controlling the decoder (stepS106) and a stepof controlling 
the BD-ROM drive 1 or the local storage 18 (step S108). 



In the following description, the Playltem currently 
subject to theplaybackprocessing is referred to as Playltem 
#x. In the processing, first, the current PL information 
(.MPLS) is read (step S101) and the steps S102-S110 are 

5 performed. The steps S102-S110 create a loop in which the 
steps S103-S110 are repeated on each piece of PI information 
included in the current PL information, until the judgment 
in the step S109 results in "YES". The Playltem subject 
to the processing steps in the loop is referred to as Playltem 

10 #x (PI #x) . When set to be the first Playltem in the current 
PL, the Playltem #x is initialized (step S102) . The 
terminal condition of the loop described above is satisfied 
when the last Playltem in the current PL is designated as 
the Playltem #x (Step S109: YES). If there is another 

15 Playltem following the Playltem #x in the current PL (Step 
S109, NO) , the next Playltem is designated as a new Playltem 
#x (Step S110) . In the steps S103-S110 repeated in the 
loop, the following are performed. First, Clip information 
specified by the Clip_inf ormation_f ile_name included in 

20 the Playltem #x is read to the scenario memory 25 (step 

5103) . The value held in the In_time of the Playltem #x 
is converted into the address u of an I picture, using the 
EP map associated with the current Clip information (step 

5104) . The value held in the Out_time of the Playltem #x 
25 is converted into the address v of an I picture, using the 

EP_map associated with the current Clip information (step 

5105) . The address of the first I picture subsequent to 
the address v is obtained, and the address immediately 



preceding the thus obtained address is designated as an 
address w (stepS107) . Finally, the playback control engine 
60 instructs the BD-ROM drove 1 or the local storage 18 
to read TS packets starting from the I picture address u 
5 and end at the address w (step S108) . 
[0103] 

In the loop composed of the steps S103-S110 described 
above, each time a new piece of PL information is read, 
it is judged whether the current PL contains CCIforPL (step 

10 Sill) . If CCIforPL is contained, the CCIforPL is set in 
the signal output unit 28, so that the CCIforPL will be 
used in the later processing (stepS112) . Through the above 
processing, each time a different piece of PL information 
is selected for playback, a different piece of CCI is set 

15 to impose a different level of restrictions on recording 
of the playback signal. Thus, copy control is carried out 
in more detail . 



(Fourth Embodiment) 

20 In the first embodiment, a single piece of CCI is 

assigned to the entire BD-ROM. A fourth embodiment of the 
present invention relates to an improvement in which 
different pieces of CCI are assigned to different AV clips. 
Fig. 21A illustrates the internal structure of BD.CCI 

25 according to the fourth embodiment. 
[0104] 

As illustrated in the figure, the BD.CCI is composed 
of a plurality of pieces of CCIforClip #1-#M. Each piece 
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of CCIforClip defines restrictions to be imposed on SD and 
HD video signals output at the time of playback of a specific 
AV clip. Fig. 21B illustrates the internal structure of 
a piece of CCIforClip. As illustrated in the figure, 
5 CCIforClip is composed of CCIforHD and CCIforSD. By using 
CCIforClip, the playback control engine 60 according to 
the fourth embodiment performs the processing steps 
illustrated in Fig. 22. The processing steps S101-S110 
illustrated in Fig. 22 are processing steps common to the 

10 other embodiments, whereas the steps Sill and S112 are unique 
to the fourth embodiment. According to the flowchart, each 
time a new AV clip is selected for playback, it is judged 
whether the AV clip contains CCIforClip (step S113) . If 
CCIforClip is contained, the CCIforClip is set in the signal 

15 output unit 28, so that the CCIforClip will be used in the 
later processing (stepS114) . Through the above processing, 
each time a different AV clip is selected for playback, 
a different piece of CCI is set to impose a different level 
of restrictions on recording of the playback signal . Thus, 

20 copy control is carried out in more detail. 



[0105] 

(Fifth Embodiment) 

In the first embodiment, a single piece of CCI is 
25 assigned to the entire BD-ROM . A fifth embodiment of the 
present invention relates to an improvement in which 
different pieces of CCI are assigned to different pieces 
of PI ay I tern information . Fig . 2 3A illustrates the internal 
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structure of BD.CCI according to the fifth embodiment. 

As illustrated in the figure, the BD.CCI is composed 
of a plurality of pieces of CCIf orPlayltem #1-#M provided 
each of which is provided for a different one of a plurality 

5 pieces of PL information. Each piece of CCI f orPlayltem 
information defines restrictions to be imposed on SD and 
HD video signals output at the time of playback of a specific 
piece of Playltem information. Fig. 23B illustrates the 
internal structure of a piece of CCIf orPlayltem. As 

10 illustrated in the figure, CCIf orPlayltem is composed of 
CCIforHD and CCIforSD. By using CCIf orPlayltem, the 
playback control engine 60 according to the fifth embodiment 
performs the processing steps illustrated in Fig. 24 . The 
processing steps S101-S110 illustrated in Fig. 24 are 

15 processing steps common to the other embodiments, whereas 
the steps S116 and S117 are unique to the fifth embodiment. 
According to the flowchart, each time a new piece of Playltem 
information is selected for playback, it is judged whether 
the Playltem information contains CCI f orPlayltem (step 

20 S116) . If CCIforPlayltem is contained, the CCI f orPlayltem 
is set in the signal output unit 28, so that the 
CCIforPlayltem will be used in the later processing (step 
S117 ) . Through the above processing, each time a different 
piece of Playltem information is selected for playback, 

25 different piece of CCI is set to impose a different level 
of restrictions on recording of the playback signal . Thus, 
copy control is carried out in more detail. 
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[0106] 

(SIXTH EMBODIMENT) 

According to the first embodiment, CCI is described 
to be contained in the BD . CCI . According to an improvement 
5 made ina sixth embodiment of the present invention, CCIforBD 
is not stored on the BD-ROM. Rather, CCIforBD is supplied 
to the signal output unit 28 from a secure memory card 61 
upon connection of the memory card 61 to the playback device . 
Fig. 25 illustrates a playback device according to 
10 the sixth embodiment. The playback device of the sixth 
embodiment is provided with a connector. The memory card 
61 is connected to the playback device via the connector. 
[0107] 

The memory card 61 is for example a non-contact 
15 semiconductor memory card and includes a logic circuit and 
a connector. When connected to the playback device via 
the connector, the memory card 61 carries out 
challenge-response mutual authentication with the playback 
device to mutually establish the validity of their 
20 identities. After successfully establishing the mutual 
authentication, the memory card 61 permits the playback 
device to access the nonvolatile memory. With this 
arrangement, access by an unauthorized device is prevented . 
In addition, owing to the large capacity of the nonvolatile 
25 memory amounting 64M bytes to 1G bytes, the memory card 
61 is suitable for storing copyrighted material. 
[0108] 

A user takes the memory card 61 to a Kiosk terminal 



set on a street, and connects the memory card 61 to the 
Kiosk terminal to acquire, on the memory card 61, a 
certificate issued by a film-distributing company. This 
certificate proves the user' s right to loosen the copy 

5 control . In the case where the local storage 32 has a secure 
area, it is applicable that such a certificate is acquired 
via the Internet using secure communications protocols and 
store the certificate in the secure area of the local storage 
32 . 

10 [0109] 

As described above, the memory card 61 is connectable 
to the playback device via the connector. When the memory 
card 61 is connected to the playback device, the CPU 4 4 
according to the sixth embodiment makes an access to the 

15 nonvolatile memory of the memory card 61 to judge if a 
certificate issued by a film-distributing company is stored 
therein. If the certificate is stored, the CPU 44 passes 
either of CCIforSD and CCIforHD both of which define a 
relatively flexible restriction. In the figure, reference 

20 numerals each associated with a black dot (#1, #2, and #3) 
schematically represent the following processes performed 
upon establishing connection with the memory card 61 . That 
is, the judgment as to whether the certificate is stored 
ornot (#1) andpassingof CCI (#2or#3) . With this mechanism, 

25 movie distributing companies are offered the option of 
additionally selling the right for recording their movies . 
If the certificate is not stored on the memory card 61 or 
if the certificate is not an authentic one, the playback 



device passes, to the signal output unit 28, CCIforSD or 
CCIforHD set to indicate "Never Copy" . This arrangement 
prevents unauthorized recording of copyrighted material 
by a malicious user. 
5 [0110] 

As described above, the sixth embodiment offers movie 
distributing companies options of launching business of 
selling, apart from selling their movies, certificates 
proving the right to loosen copy control imposed on the 
10 movies. This will make a significant contribution to the 
movie industry. 



(Seventh Embodiment) 

According to a feature of the third embodiment, two 
15 different types of CCI, which are CCIforHD and CCIforSD, 
are provided. According to a seventh embodiment of the 
present invention, CCIforHD and CCIforSD are each 
additionally provided with attributes. 
[0111] 

20 Fig. 26 illustrates the internal structure of CCIforPL 

according to the seventh embodiment. In the figure, the 
"CCIforHD without CM" and the "CCIforSD without CM" are 
identical in substance to the CCIforHD and CCIforSD of the 
third embodiment, respectively. The "CCIforHD with CM" 

25 and "CCIforSD with CM" are the CCI having new attributes. 

Because of the new attributers, the copy control 
information requires supplemental information to be added 
to the video signal output. This embodiment is described 



using an example in which the supplemental information is 
advertisement or one ore more "Commercial Messages (CMs)". 
[0112] 

The "CCIforHD with CM" defines restrictions to be 
5 imposed on recording of an HD video signal output with 
addition of a CM. 

The "CCIfroHD without CM" defines restrictions to be 
imposed on recording of an HD video signal output without 
addition of a CM. 
10 The "CCIforSD with CM" defines restrictions to be 

imposed on recording of an SD video signal output with 
addition of a CM. 
[0113] 

The "CCIfroSD without CM" defines restrictions to be 
15 imposed on recording of an SD video signal output without 
addition of a CM. 

The CM used herein refers to any form of information 
for advertising goods, events, organizations, and groups 
to the public. In this embodiment, the CM is a preview 
20 of an upcoming movie. 
[0114] 

Fig. 27 illustrates an example setting of "CCIforHD 
with CM" and "CCIforHD without CM". Fig. 28 illustrates 
an example setting of "CCIforSD with CM" and "CCIforSD 
25 without CM". Any of "CCIforHD with CM", "CCIforHD without 
CM", "CCIforSD with CM", and "CCIforSD without CM" can be 
set to indicate Copy Free, Only One Copy, Never Copy, or 
EPN Copy Free. 



With the additionally provided attributes of "with 
CM" and "without CM", an advantageous effect is achieved 
that the CCIforHD and CCIforSD are able to define different 
restrictions on recording of a video signal depending on 
5 whether the video signal is output with or without addition 
of CM. 
[0115] 

Fig. 29 illustrates the copy restrictions defined with 
the use of the additionally provided attributes. 

10 According to the first embodiment, CCIforHD is set 

to the Never Copy status and CCIforSD is set to the Only 
One Copy status. According to this embodiment, CCIforHD 
having the "with CM" attribute is set to the Only One Copy 
status, and CCIforSD having the "with CM" attribute is set 

15 to the Copy Free status. The provision of the attribute 
offers users options of obtaining the right for loosening 
the restrictions imposed on recording of a video signal, 
in return for accepting CM to be added to the video playback. 
[0116] 

20 Now, a discussion is given about how subtitles are 

presented on movie playback. CM content to be attached 
to movie content is provided using a SubClip, Clip 
information, PL information stored on the local storage 
32. Fig. 30 illustrates an example of CM content stored 

25 on the local storage 32. As illustrated in the figure, 
the CM content is composed of a file called "00005. M2TS" 
containing a SubClip, a file called "00005 . CLPI" containing 
Clip information associated with the SubClip, and a file 



called "00005. MPLS" containing PL information defining a 
playbackpath for synchronous playback of the SubClip stored 
on the local storage 32 with the AV clip stored on the BD-ROM. 
CCIforPL composed of CCIforHD with/without CM and CCIforSD 
5 with/without CM is associated with the PL information stored 
on the local storage 32. 
[0117] 

Fig. 31A illustrates the structure of the SubClip that 
constitutes the CM content. As illustrated in the figure, 

10 the SubClip is generated in the following way. First, the 
text subtitle stream illustrated on the first level is 
converted into PES packets (illustrated on the second level ) , 
and the PES packets are further converted into TS packets 
(illustrated on the third level) . Fig. 31B illustrates 

15 the internal structure of the text subtitle substream. The 
text subtitle stream is composed of a single "DSU 
(Dialog_Style_Unit ) " field at the top of the stream and 
a plurality of "DPU ( Dialog_Presentation_Unit ) " fields. 
The DSU includes region information specifying a display 

20 region in which text subtitles are presented. More 
specifically, the region information includes 
"region_horizontal_position" and 
"region_vertical_jposition" specifying the horizontal and 
vertical positions of the display region, respectively. 

25 The region information also includes "region_width" and 
"region_height" specifying the width and height of the 
display region, respectively. 
[0118] 



Each DPU includes "dialog_start_PTS" indicating the 
presentation start time of the subtitles, "dialog_end_PTS" 
indicating the presentation end time of the subtitles, 
M region_id" uniguely specifying the display region in which 

5 the text subtitles are presented, and "text_string" to be 
presented as subtitles. 

Fig. 32 illustrates the internal structure of PL 
information constituting the CM content. Similarly to the 
PL information described above in the first embodiment, 

10 PL information constituting CM content also includes 
MainPathO and SubPath ( ) . Leader lines mpl in the figure 
indicate that the structure of the MainPath information 
is illustrated in greater detail. As indicated by the 
leader lines, the MainPath information includes one or more 

15 pieces of Playltem information. Leader lines mp2 in the 
figure illustrate that the structure of Playltem 
information is illustrated in greater detail . As indicated 
by the leader lines, Playltem information is composed 
"Clip_information_f ile_name", M In_time", and "Out_time" . 

20 Leader lines mp3 indicate that the structure of SubPath 
information is illustrated in greater detail . As indicated 
by the leader lines, the SubPath information includes one 
of more pieces of SubPlayltem information. 
[0119] 

25 As described above, the PL information according to 

this embodiment is identical in internal structure to the 
PL information stored on the BD-ROM but differs in the 
following point. Unlike the PL information stored on the 



BD-ROM, the PL information of the seventh embodiment is 
capable of designating any Clip information regardless of 
whether the Clip information is stored on the BD-ROM or 
the local storage 32. The PL information stored on the 
5 local storage 32 can designate Clip information stored on 
the BD-ROM without specifying a full path- It is because 
the playback device recognizes all the directories and files 
on the local storage 32 and on the BD-ROM as a single virtual 
file system. Thus, Clip__inf ormation_f ile_name included 

10 in the Playltem information or in the SubPlayltem 
information can specify any of the AV clips stored on the 
local storage 32 and BD-ROM using a five-digit number of 
a file body containing the Clip information. The playback 
device reads the content stored on the local storage 32 

15 and dynamically synchronizes with the content stored on 
the BD-ROM, so that the BD-ROM content is played back in 
richer variations . 
[0120] 

In addition, the PL information of the seventh 
20 embodiment also differs from the PL information of the first 
embodiment in that the SubPath information included therein 
is capable of one-to-multiple synchronization. 
Specifically, "one" in the "one-to-multiple" refers to the 
text substream (SubClip) stored on the local storage 32, 
25 whereas "multiple" refers to a plurality of pieces of 
Playltem information included in the PL information. For 
example, the PL information illustrated in Fig. 33 includes 
SubPath information defining that a single text subtitle 



stream is repeatedly played back in synchronism with each 
of a plurality of pieces Playltem information. 
[0121] 

Fig. 33 illustrates the internal structure of Playltem 
5 information illustrated in Fig. 32. Leader lines sh2 in 
the figure indicate that the structure of SubPlayltem 
information is illustrated in greater detail . As indicated 
by the leader lines, the SubPlayltem information is composed 
of the following fields: "Clip_inf ormation__f ile_name" , 
10 "In__time", "Out_time", "syncJPlayl tem_id" , and 

"sync_start_PTS_of_PlayItem" . Among the above fields, 
the "Clip_information__f ile_name" field is set to specify 
a file name commonly among a plurality of pieces of Playltem 
information. The "sync_PlayItem__id" and 

15 "sync_start_PTS_of_PlayItem" fields, on the other hand, 
are set to values unique to a respective piece of Playltem 
information . 
[0122] 

Fig. 34 illustrates the timeline of PlayList playback 
20 defined by the PL information stored on the local storage 
32 . In the figure, the first level illustrates the playback 
timeline of the AV clip stored on the BD-ROM. The second 
level illustrates the timeline of PlayList playback defined 
by the PL information stored on the local storage 32. As 
25 illustrated on the first and second levels of the figure, 
the. PL information stored on the local storage 32 can be 
used to define a different timeline for playback of the 
AV clip stored on the BD-ROM. The third level illustrates 
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the timeline defined for playback of SubClip stored on the 
local storage 32. The SubPlayltem. In_time and the 
SubPlayltem. Out_time define the start and end points of 
the playback section of the SubClip. That is, the playback 

5 section is defined also on the SubClip timeline. Arrows 
Snl and Sn2 indicate the synchronous playback defined by 
the Sync_PlayItem_id and the sync_start__PTS_of_PlayI tern 
in each SubPlayltem (SubPlayltem #1, #2). More 
specifically, the arrow snl indicates the designation by 

10 SubPlayltem #1. 
[0123] 

Since the Sync_PlayI tem_id in the SubPlayltem #1 
designates Playltem #1, the SubClip stored on the local 
storage 32 is played back in synchronism with the Playltem 
15 #1. 

The arrow Sn2 indicates the synchronous playback 
defined by Sync_PlayI tem_id and 

sync_start_PTS_o f_PlayItem. 

Since the Sync_PlayI tem_id in the SubPlayltem #2 
20 designates Playltem #3, the SubClip stored on the local 
storage 32 will be played back in synchronism with the 
Playltem #1. Because of the above setting of SubPlayltem 
#1 and #2, the text subtitle stream stored on the local 
storage 32 is played back synchronously with Playltem #1 
25 as well as with Playltem #2. 

As above, with the use of a plurality of pieces of 
SubPlayltem information, SubPath information can define 
playback control that a single SubClip is played back 
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repeatedly in synchronism with each of multiple pieces of 
Playltem information. With such repetitive presentation 
of CM content to users, the CM content is likely to achieve 
high advertising effect. 
5 [0124] 

Fig. 35A illustrates an example setting of the DSU 
and the DPU. In this example, the region information #1 
included in the DSU is set to indicate a region of the 
presentation graphics plane 18, with the coordinate (xl, 
10 yl), the width RW, and the height RH. 
[0125] 

The four DPUs illustrated in Fig. 35A all specify the 
region information #1 defined in the DSU. Yet, each DPU 
designates with its dialog_s tart_PTS a different one of 

15 tl, t2, and t3. The text strings defined by the respective 
DPUs read as follows, "AAA Film Company'', "Coming Soon", 
"US No. 1 Hit", and "Super 3". As a result of the above 
setting, the subtitles set by the DPUs are sequentially 
presented in synchronism with video playback. 

20 [0126] 

The PL information stored on the local storage 32 
defines synchronization of the text subtitle stream 
(SubClip) containing the DPUs illustrated in Fig . 35A, with 
the AV clip stored on the BD-ROM. Consequently, the text 
25 strings are sequentially presented at the specified 
presentation start time and at the specified position on 
the presentation graphics plane 18. As a result, the 
composite images as illustrated in Fig . 35B are sequentially 



played back. 

Since such PL information as above is stored on the 
local storage 32, a display effect is archived in which 
text subtitles are sequentially changed in synchronism with 
5 playback of the AV clip stored on the BD-ROM. The subtitles 
are, for example, commercial messages of the 
f ilm-distributing company. By displaying such subtitles, 
playback of the PL information always involves display of 
CM. Alternatively to such a movie preview as described 

10 above, CM content presented according to this embodiment 
maybe a so-called logo CM. A logo CM refers to a dynamically 
presented logo image of a film-distributing or 
film-production company. Generally, such a logo image is 
often presented at the beginning of a movie and thus well 

15 recognized as a house mark of the film-distributing or 
film-production company . 
[0127] 

As described above, on condition that a video signal 
is output with addition of a text subtitle stream, less 

20 strict restrictions are imposed on recording of such a video 
signal. That is, users obtain the right to record a movie 
in return for viewing advertisement. In the above 
description, the CM content is, but not limited to, a text 
subtitle. Similar advertisement effect is archived by 

25 presenting some additional images to playback of the 
original video content. Other than text subtitles, for 
example, CM content may be a bitmap image or an animation 
sequence of bitmap images. Although no specific 



description of such variations of CM content is given here, 
the mechanism of presentation graphics used for presenting 
movie subtitles of BD-ROM content may be employed for CM 
presentation . 

This concludes the description of the improvement made 
on the recordingmediumaccording to this embodiment . Next, 
the following describes an improvement made on the playback 
device according to the present invention. Fig. 36 
illustrates the improvement made on the playback device 
according the seventh embodiment. As illustrated in the 
figure, the PSR set 46 includes a PSR(23) . The PSR(23) 
indicates whether a user accepts addition of CM. 

Fig. 37A illustrates the meaning of values that the 
PSR (23) may hold. As illustrated in the figure, when set 
to x> l", the PSR (23) indicates that the user accepts addition 
of CM. When set to "0", the PSR (23) indicates that the 
user refuses addition of CM. 
[0128] 

In addition, the instruction ROM 45 is additionally 
provided with a setup-menu processing unit 63 as a control 
program for executing setup of the playback device. 

In response to a user operation made on the remote 
controller for calling a setup menu, the setup-menu 
processing unit 63 instructs the signal output unit 28 to 
display a setup menu. In response to a user operation for 
selecting whether to accept addition of CM, the setup-menu 
processing unit 63 writes the value corresponding to the 
user operation to the PSR(23). Fig. 37B illustrates an 
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example of a setup menu. As illustrated in the figure, 
items selectable on the set-up menu generally include the 
following five items: viewer restriction, country/region, 
menu language, audio language, and subtitles language. In 
5 addition, the set-up menu in this embodiment includes the 
item for selecting whether to accept or refuse "CM Addition" . 
[0129] 

Fig. 38 illustrates a flowchart of the setup processing 
performed by the setup-menu processing unit 63. The 

10 processing steps of the flowchart are executed in response 
to a user operation made on the remote controller for calling 
the setup menu. According to the flowchart, the setup-menu 
processing unit 63 is placed in standby for receiving a 
user input of selecting one of the menu items for setting 

15 (step S81) . Upon receipt of the user input, the setup-menu 
processing unit 63 judges whether the selected menu item 
is the "CM addition" (step S82) . If the selected menu item 
is other than "CM addition", the setup-menu processing unit 
63 receives a user input related to the selected menu item. 

20 On the other hand, if the selected item is "CM addition", 
the setup-menu processing unit 63 receives a user input 
selecting whether to accept or refuse CM addition. If CM 
addition is selected to be "refused" (step S83, NO), the 
PSR(23) from among the plurality of PSRs of the PSR set 

25 46 is set to the value "0" indicating that CM addition is 
"refused" (step S85) . On the other hand, if CM addition 
is selected to be "accepted" (step S83, YES), the PSR(23) 
is set to "1" indicating that CM addition is "accepted" 



(step S84). This concludes the description of the 
processing steps performed by the setup-menu processing 
unit 63. 

[0130] 

5 Next, a description is given of the improvement made 

on the playback control engine 60 according to this 
embodiment . 

Once the PRS (23) is set to either "0"or "1", theplayback 
control engine 60 controls the compositors 54 and 57 included 

10 in the signal output unit 28. Under the control, at the 
time of PlayList playback, an appropriate piece of CGMS 
is selected according to the value held in the PSR(23) and 
the selected CGMS is embedded into the output video signal. 
More specifically, when the PSR(23) is set to "0" indicating 

15 that CM addition is "refused" , the playback control engine 
60 instructs the signal output unit 28 to embed CGMS composed 
of "CCIforSD without CM" and "CCIforHD without CM". On 
the other hand, when the PSR(23) is set to "1" indicating 
that CM addition is "accepted", the playback control engine 

20 60 instructs the signal output unit 28 to embed CGMS composed 
of "CCIforSD with CM" and "CCIforHD with CM". 
[0131] 

CGMS composed of "CCIforSD with CM" and "CCIforSD with 
CM" is embedded through the processing illustrated in Fig. 
25 39. 

Fig. 39 is a flowchart of the processing steps performed 
by the playback control engine 60 according to the seventh 
embodiment. This flowchart is an improved version of the 
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flowchart illustrated in Fig. 20. The improvement lies 
in a step S130 added before the step S101. If the judgment 
in the stepS130 results in"NO", the same playbackprocessing 
as that described in the second embodiment will be executed. 
5 [0132] 

On the other hand, if the judgment in the step S130 
results in "YES", the steps S101-S110 are sequentially 
performed . The difference with the processing of the second 
embodiment illustrated in Fig. 20 is found in that the steps 

10 Sill and S112 are replaced with steps S121 and S122, 
respectively. Through the above steps unique to this 
embodiment, the playback control engine 60 judges, each 
time a piece of PL information is read, whether CCIforPL 
is contained (step S121) . If CCIforPL is contained, the 

15 playback control engine 60 sets the signal output unit 28 
so that the compositors 54 and 57 embed CGMS composed of 
"CCIforSDwithCM"and"CCIforHDwithCM" (stepS122) . This 
concludes the description of the PL information payback 
control. As described above, in order to synchronize CM 

20 content with AV clip playback, it is necessary to monitor 
when the current playback point reaches In_t ime and Out_time 
of the SubPlayltem. The monitoring is carried out as one 
sequence through the control of the video decoder 8, the 
stream graphics processor 14, the coded data buffer 22, 

25 and the text subtitle decoder 42. Fig. 40 illustrates the 
processing steps performed for controlling the video 
decoder 8, the stream graphics processor 14, the coded data 
buffer 22, and the text subtitle decoder 4 2 . The processing 



of this flowchart is to perform a loop composed of steps 
S132-137 after setting the current PTM to the PTS value 
of an I picture (step S138) . 
[0133] 

5 Next, a description of the loop composed of the steps 

S132-S135 is given. In the loop, playback of the picture 
and audio located at the current PTM (step S132) and update 
of the current PTM (step S133) are repeated. The step S134 
defines the terminal condition to be met to exit form the 

10 loop. More specifically, the loop is terminated when it 
is judged in the step S134 that the current PTM reaches 
Out_time of the PI #x. 
[0134] 

In the step S135, it is judged whether there is 
15 SubPlayItem#y of which sync_PlayItem_id specifies Playltem 
#x. If there is such SubPlayltem #y, it is then judged 
in the step S136 whether the current PTM has reached 
sync_start_PTS__of_PlayItem of SubPlayltem #y. If the 
current PTM is reached, playback of SubPlayltem #y is 
20 executed in the step S137. 

Fig. 41 illustrates a flowchart of the processing steps 
performed for playback of SubPlayltem #y. 

In the step S147, Clip information that is specified 
by the Clip_inf ormation_f ile_name of SubPlayltem #y is read. 
25 In the step S148, the value of In_time of SubPlayltem #y 
is converted into an address or, using the EP_map associated 
with the current Clip information. Similarly, in the step 
S149, the value of Out_time of SubPlayltem #y is converted 



into an address (3, using the EP_map associated with the 
current Clip information. In the step S150, the decoder 
is instructed to output SubPlayltem #y starting from a point 
specif iedby In_time and end at a point specif iedby Out_time . 
Then, the address of the first I picture after the address 
(3 is calculated and the address immediately before the thus 
calculated address is set as an address y (step S151) . Then, 
the BD-drive 1 or the local storage 18 is instructed to 
read Subclip #z, so that a sequence of TS packets starting 
from the address a and end at the address y is read (step 
S152) . 
[0135] 

Through the above processing steps, both the MainPath 
playback and the SubPath playback are executed in 
synchronism, so that composite images as illustrated in 
Fig. 35B are presented. In the steps S121-S122 of the 
flowchart illustrated in Fig. 39, CCIforPL composed of 
"CCIforHD with CM" and "CCIforSD with CM" is set in the 
signal output unit 28, so that the CCIforPL will be used 
in the later processing. As a consequence, at the time 
of video signal output, CGMS imposing less strict 
restrictions is embedded within the SD and HD video signals . 
[0136] 

Fig. 42A illustrates a video sequence presented on 
a TV without CM added thereto, and Fig. 42B illustrates 
an SD video signal carrying the video sequence. As 
illustrated in Fig. 42B, the SD video signal carries, in 
the vertical blanking intervals, CGMS that indicates the 
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Only One Copy status. Since such CGMS is embedded, the 
recording device 600 is permitted to record the SD video 
signal once and once only. 

Figs. 43A illustrates a video sequence presented on 

5 a TV with CM added thereto, and Fig. 43B illustrates an 
SD video signal carrying the video sequence . As illustrated 
in Fig. 43B, the SD video signal carries, in the vertical 
blanking intervals, CGMS indicating the Copy Free status. 
Since such CGMS is embedded, less strict restrictions are 

10 imposed and the recording device 600 is permitted freely 
record the SD video signal. 
[0137] 

As described above, according to this embodiment, CCI 
is set to permit copying of movie content, on condition 

15 that CM is added to the movie content . That is, by accepting 
that CM is added to movie content, a user is permitted to 
freely copy the digitized movie content. Such a copy of 
the movie content may be stored on the HD recorder or home 
server. Playback of such a copy is presented with the CM 

20 added thereto. Thus, whenever watching the movie content, 
the user has no choice but to watch CM. Consequently, a 
certain level of advertising effect is expected. Since 
users are offered the right to make personal copies of movie 
content in exchange for watching CM, this f ormof advertising 

25 works with the users' consent. In other words, since the 
users are offered the choices as to whether or not to accept 
such advertising via a copy of original content, the 
advertising effect can be increased without offending the 



users . 
[0138] 

(Eighth Embodiment) 
5 According to the first embodiment, CM content is 

pre-recorded on a BD-ROM. An eighth embodiment of the 
present invention relates to the case where CM content is 
downloaded from a WWW server. Fig. 4 4 A illustrates CCIforPL 
included in CCIforBD associated with CM content to be 

10 downloaded. Fig. 44A illustrates the internal structure 
of CCIforPL according to the eighth embodiment. As 
illustrated in the figure, the CCIforPL according to the 
eighth embodiment does not contain any CCI . Instead of 
CCI, CCIforPL defines a URL indicating the address on a 

15 network from which CM content and CCI is to be downloaded. 
[0139] 

Since CCIforBD contains no CCI but an URL, at the time 
of video output, the network device 31 accesses the WWW 
server at the URL and downloads CM content and CCI from 

20 the WWW server. 

Fig. 44B illustrates the internal structure of a CM 
request that the network device 31 issues for downloading 
CM content. As illustrated in the figure, the CM request 
includes the Disc ID recorded in the lead-in area of the 

25 BD-ROM. 
[0140] 

For downloading CM content, the CPU 4 4 instructs the 
network device 31 to issue a CM request that includes the 
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Disc ID. Fig. 45 schematically illustrates acquisition 
of the Disc ID by the CPU 44 (*1), and the transmission 
of a CM request to the WWW server from the network device 
31 (*2, and *3) . In response to the CM request transmitted 

5 as above, the WWW server retrieves, from its own database, 
CM content associated with the received Disc ID. The WWW 
server then encrypts "CCIforSD with CM" and "CCIforHD with 
CM" using the Disc ID, and transmits the encrypted "CCIforHD 
with CM" and "CCIforSD with CM" back to the playback device 

10 that issued the request . Fig. 4 6 schematically illustrates 
the transmission of the CM content and the CCI from the 
WWW server to the playback device (*3, *4, and *5) . Upon 
receipt of the CM content and the CCI, the playback device 
records the CM content to the local storage 32 and decrypts 

15 the "CCIforSD with CM" and "CCIforHD with CM" using the 
Disc ID to obtain the "CCIforSD with CM" and "CCIforHD with 
CM" in plaintext. 
[0141] 

As described above, according to this embodiment, CM 
20 content is downloaded from a WWW server and presented in 
synchronism with movie content. Thus, it is made possible 
to present to users the latest version of CM content with 
the latest version of CCI information, simply by supplying 
such CM content to a WWW server. 

25 

(Ninth Embodiment) 

According to the eighth embodiment , the playback device 
issues, to the server, a CM request that contains the Disc 



ID. According to a ninth embodiment, a CM request contains 
maker information in addition to the Disc ID. 
[0142] 

Fig. 47 illustrates the internal structure of a CM 
5 request according to the ninth embodiment. As illustrated 
in the figure, the CM request according to this embodiment 
contains maker information in addition to the Disc ID. The 
maker information is composed of a "maker ID" identifying 
the maker of the playback device and a "model number" assigned 
10 by the maker to the playback device . The maker information 
illustrated in the figure is stored in a secure semiconductor 
module provided within the playback device and in a 
non-rewritable state . 
[0143] 

15 For issuing a CM request, the CPU 44 fetches the maker 

information from the secure semiconductor module mentioned 
above, and instructs the network device 31 to transmit a 
CM request composed of the maker information and the Disc 
ID. Fig. 48 schematically illustrates the acquisition of 

20 the maker information and the Disc ID by the CPU 44 (*1) 
as well as the transmission of the CM request to the WWW 
server, also by the CPU 44 (*2 and *3) . Upon receipt of 
the CM request transmitted in the above manner, the WWW 
server operates just as described in the eighth embodiment. 

25 More specifically, the WWW server retrieves, from its own 
database, CM content associated with the received Disc ID, 
encrypts CCI using the Disc ID, and transmits the CM content 
and the encrypted CCI back to the playback device that issued 



the CM request. 
[0144] 

Next, the following describes the uses of maker 
information transmitted to the WWW server 700. Fig. 49 

5 illustrates the uses of maker information. Transmission 
requests similar to the one illustrated in Fig. 48 are issued 
from playback devices around the world. With reference 
to the maker information, the WWW server 700 calculates 
the number of received transmission requests separately 

10 for each maker. 

Based on the calculation result of the transmission 
requests, a film-distributing company 800 makes a judgment 
regarding the contribution of each maker to advertising 
effect having been achieved. The film-distributing 

15 company 800 pays advertisement fees to a maker 900 in 
accordance with the contribution. 
[0145] 

As described above, according to this embodiment, the 
playback device transmits maker information to the WWW 

20 server, for acquiring CM content . This arrangement allows 
the film-distributing company to figure out how much each 
maker (of playback devices) contributes to the advertising 
effect. Monetary reward for such contribution would be 
new revenue that the maker can obtain by providing 

25 advertisement via copies of original content. 



(Tenth Embodiment) 

According to the seventh embodiment, CM content is 
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stored on the local storage. According to a tenth 
embodiment of the present invention, CM content is stored 
on the BD-ROM and a permission request is issued. Fig. 
50 illustrates the application format of the BD-ROM 
5 according to the tenth embodiment. As illustrated in the 
figure, the BD-ROM stores a SubClip that constitutes CM 
content, Clip information, and PL information. Since the 
SubClip, Clip information, and PL information are stored 
on the BD-ROM, even a playback device not provided with 
10 a local storage is able to present playback of movie content 
in synchronism with CM content. When outputting playback 
of movie content with addition of CM content, the playback 
device embeds, in the HD and SD video signals, CGMS imposing 
less strict restrictions of recording of the movie content . 

15 

[0146] 

(Eleventh Embodiment) 

According to the seventh embodiment, a SubClip 

constituting CM content is stored on the BD-ROM and the 
20 SubClip contains text substreams . According to an eleventh 

embodiment of the present invention, a graphics stream is 

provided for presenting CM (hereinafter, also referred to 

as "CM graphics stream") , and the graphics stream is 

multiplexed into an AV clip. 
25 Fig. 51 illustrates the structure of the AV clip 

multiplexed with a CM graphics stream. 
[0147] 

As illustrated on the first level from the bottom, 
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the AV clip according to this embodiment contains a CM 
graphics stream. Fig. 52A illustrates the content of ODS 

(Object Definition Segment) and PDS (Palette Definition 
Segment) carried in the CM graphics stream. The ODS 
5 contains run-length coded graphics data used for CM 
presentation . 

[0148] 

Hereinafter, a description is given of the ODS and- 
the PDS from among a plurality of functional segments 

10 constituting the CM graphics stream. 

The ODS is a functional segment defining a graphics 
object used to present text strings or figures serving as 
CM. The graphics object composed of a plurality of pieces 
of run-length data. Each piece of run-length data is 

15 composed of a pixel code representing a pixel value and 
a run-length count of the pixel value. The pixel code is 
an 8-bit value showing one of the values from 1 to 255. 
Through the use of this pixel code, the run-length data 
sets arbitrary 256 pixel colors out of full colors 

20 (16, 777, 216 colors). Note that a graphic object used to 
present text subtitles needs to be rendered by placing a 
text string with a transparent background color. 
[0149] 

The PDS is a functional segment that defines pallet 
25 data used for color conversion. The pallet data shows 
combinations of pixel codes of 1 to 255 and pixel values. 
The pixel value used herein is made up of a red color 
difference component (Cr value) , a blue color difference 



component (Cb value) , a luminance component (Y value) , and 
a transparency (T value) . Substituting a pixel code of 
each piece of run-length data into a pixel value shown by 
the palette data produces a color. 
5 [0150] 

For causing the CM graphics stream to be selected, 
the BD-ROM according to this embodiment stores CCI 
(CCIforClip) that is unique to this AV clip. Fig. 52B 
-illustrates the CCIforClip that is unique to the AV clip. 

10 The "CCI for AV clip" illustrated in Fig. 52B includes 

PID that uniquely identifies the above-mentioned CM 
graphics stream (i.e. PG stream used for CM presentation) . 
At the time of playback, the playback device sets the value 
of the PID to the filter 4, so that the CM graphics stream 

15 is decoded and played back. Consequently, CGMS defining 
less strict restrictions is embedded in the HD and SD video 
signals. Alternatively to PID, any information uniquely 
identifying the CM graphics stream may be used. 
[0151] 

20 This concludes the description of the improvement made 

on the recording medium. Now, a description is given of 
the improvement made on the playback device. In the 
flowchart illustrated in Fig. 22, the steps S113 and S114 
are unique to the processing of CCIforClip. According to 

25 the eleventh embodiment, the step S113 is modified as 
illustrated in Fig. 53. In addition, the step S114 is 
replaced by steps sl61-S164 also as illustrated in Fig. 
53. Now, a description of the steps S161-S164 is given. 



[0152] 

According to the flowchart in Fig- 53, each time a 
new AV clip is selected for playback, it is judged whether 
the value held by the PSR ( 23} is "1" (step SI 61) . ThePSR(23) 

5 represents the setting as to whether CM presentation is 
permitted by the user. If set to the value "0" indicating 
that CM presentation is not accepted, the signal output 
unit 28 is set to embed "CCIforSD without CM" and "CCIforHD 
without CM" included in CCIf orPL associated with the current 

10 AV clip (step S162) . 
[0153] 

On the other hand, if thePSR(23) is set to "1" indicating 
that CM presentation is accepted, the playback device 
fetches PID from CCIforClip associated with the AV clip 

15 and sets the value of PID to the PID filter 4 (step S163) . 
As a result of this setting, during playback of the AV clip 
illustrated in Fig. 51, the CM graphics stream is selected 
by the PID filter 4 and output to the stream graphics 
processor 41. Then, the signal output unit 28 is set to 

20 embed "CCIforSD with CM" and "CCIforHD with CM" included 
in CCIf or PL associated with the current AV clip (step SI 64 ) . 
[0154] 

As described above, according to this embodiment, a 
CM graphics stream is multiplexed with an AV clip, so that 
25 the CM is presented to users when the AV clip is selected 
for playback. 

( Supplemental Note ) 

82 



The above description does not cover all the 
embodiments of the present invention. The present 
invention may be embodied by any embodiments including the 
following (A) to (T) below. The invention recited in each 
of the claims of this application includes extension and 
generalization of the above embodiments and their 
modifications below. The degree of extension and 
generalization depends upon the state of the art in the 
technical field of the present invention at the time when 
the present invention was made. 
[0155] 

(A) According to the above embodiments, the BD-ROM 
stores PG and IG streams of HD quality only. Yet, it is 
applicable that the BD-ROM also stores PG and IG streams 
separately provided for down-conversion. At the time of 
down-converting, the selection may be made by the playback 
device or by a user. 

(B) According to the above embodiments, a PG stream 
may be used to present text subtitles. However, the image 
quality of the PG stream may not be maintained at a 
satisfactory level if the PG stream is down-converted. In 
view of this, it is desirable that down-conversion is 
performed using a vector image font such as True Type font. 
[0156] 

(C) Each of the above embodiments relates to a player 
model provided with separate converters optimum for video, 
PG, and IG streams, so as not to degrade image quality. 
Yet, it is applicable to first generate composite images 
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at the HD level, and then down-convert the HD video signal 
to an SD video signal. If it is expected in this case that 
Pan & Scan should be applied to adjust the down-converted 
image into a 4 : 3 aspect ratio television image, the display 
5 region of text subtitles may be adjusted (especially, 
widthwise) so as to fit within such a 4:3 aspect ratio 
television image. 
[0157] 

(D) Although the above embodiments do not provide a 
10 detailed description regarding how to set the display region 
of text subtitles, the setting may be made in view of 
down-converting. More specifically, different display 
regions may be set for the letterbox of down-converted NTSC, 
Pan & Scan for down-converted NTSC, letterbox of 
15 down-converted PAL, and Pan & Scan for down-converted PAL. 
It is also applicable to set different display regions and 
allowing a user to arbitrary select any of the display regions 
according to the user's preference. 
[0158] 

20 (E) According to the first embodiment, a specific field 

is repeatedly presented at the time of down-converting 
through the field doubling process. Yet, the following 
modif icationmay be made to reduce image fluctuations . That 
is, at the time of down-conversion by the field doubling 

25 process, an interim field picture is generated from and 
inserted between the previous and subsequent pictures . For 
example, the secondpicture P5t of 50 Hz-FD (PAL) illustrated 
in the figure may be generated from the pictures P5 and 



P6 of the 24 Hz (film) . 
[0159] 

(F) The above embodiments relate to the BD-ROM and 
the playback device. Yet, it is applicable that CCIforHD 

5 and CCIf orSD are multiplexed in a digital broadcast stream. 

(G) According to the above embodiments, a different 
piece of CCI is defined for a different piece of PlayList 
information. Yet, it is applicable that a different piece 
of CCI is selectable by a Java application (programor script 

10 for playback control) . 

(H) It is desirable that the subtitles and the portions 
covered by the subtitles are always presented 
simultaneously. It is because such setting makes it easier 
to establish correspondence between HDTV and SDTV in the 

15 case of simultaneous output of the HDTV and SDTV signals. 
[0160] 

(I) An audio down-coverer A-DC may be connected to 
the output end of the audio decoder 39. Down sampling by 
the audio down-converter A-DC ensures audio output at the 

20 SDTV quality. 

(J) CCIforBD may contain "APSTB" . APSTB is a two-bit 
value indicating whether to apply analog protection to SD 
video signal. When set to the value "01", APSTB indicates 
that analog protection is applied by disturbing the AGC 

25 circuit of VTR. When set to the value of "10", APSTB 
indicates that analog protection is applied by the AGC 
process and two-line color stripe system. When set to the 
value of "11", APSTB indicates that analog protection is 



appliedby the AGC process and four-line color stripe system. 
When set to the value of "00", APSTB indicates that no analog 
protection is applied. 
[0161] 

5 (K) The first embodiment relates to a player model 

based on the T-STD of MPEG-TS . Yet, the present invention 
is applicable to a player model based on the MPEG-PS or 
other multiplexing technique. In addition, at the time 
of performing down-conversion, the playback device may 

10 display recommendations for down-conversion described in 
the Clip information and allows users to select the type 
of down-conversion . 
[0162] 

(L) As. a result of the conversion of display method 
15 by the output control unit 51, the AV clip may be played 
back at a different speed than that originally defined. 
In such a case, it is not necessary that output control 
unit 51 carries out decoding at the timing specified by 
the DTS. 

20 (M) Each of the above embodiments relates to the case 

where the BD-ROM is used as the recording medium. Main 
features of the present invention, however, lie in a graphics 
stream recorded on the recording medium, which does not 
rely on physical characteristics of the BD-ROM. Therefore, 

25 the present invention is applicable to any recording media 
capable of recording a graphics stream. Examples of such 
recording media include: optical discs such as DVD-ROM, 
DVD-RAM, DVD-RW, DVD-R, DVD+RW, DVD+R, CD-R, and CD-RW; 



magneto-optical disks such as PD and MO; semiconductor 
memory cards such as CompactFlash, SmartMedia, Memory Stick, 
MultiMediaCard, and PCMCIA; magnetic disks such as flexible 
disk, SuperDisk, Zip, andClik!; removable hard disk drives 
5 such as ORB, Jaz, SparQ, SyJet, EZFley, and Microdrive; 
and built-in hard disk drives. 
[0163] 

Each of the above embodiments relates to the case where 
the playback device decodes an AV clip stored on the BD-ROM 

10 and outputs the decoded AV clip to the television. As an 
alternative, the playback apparatus may be equipped with 
a BD drive only and the remaining components are provided 
in the television. In such a case, the playback apparatus 
and the television can be incorporated in a home network 

15 connected with an IEEE 1394 connector. In addition, 
although the above embodiments relate to the case where 
the playback device is connected to the television, the 
playback device may instead be a playback device integrally 
provided with a display device. Also, the playback device 

20 may include only the system LSI (integrated circuit) that 
carries out an essential part of the processing. The 
playback apparatus and the integrated circuit are both an 
invention described in this specification. Accordingly, 
regardless of whether the playback device or the integrated 

25 circuit is concerned, an act of manufacturing a playback 
device based on the internal structure of the playback device 
described in the sixth embodiment is considered to be an 
act of practicing the present invention. Also, any act 



of assigning with charge (i.e. for sale) or without charge 
(i.e. asagift), leasing, and importing the playback device 
according to the first embodiment is an act of practicing 
the present invention. Likewise, an act of offering for 
5 assignment or lease of the playback device using storefront 
displays, catalogs, or brochures is an act of practicing 
the present invention. 
[0164] 

(O) Information processing using the programs shown 

10 in the flowcharts is actually realized using hardware 
resources. Accordingly, the programs, which describe the 
processing steps shown in the flowcharts, are themselves 
an invention. The above embodiments all relate to the case 
where the programs are incorporated in the playback device, 

15 but the programs can be used independently of the playback 
device. Acts of practicing the programs include (1) an 
act of manufacturing, (2 ) an act of assigning with or without 
charge, (3) an act of leasing, (4) an act of importing, 
(5) an act of providing to the public via a bi-directional 

20 electronic communications network, and (6) an act of 
offering for assignment or lease using storefront displays, 
catalogs, or brochures. 

(P) The temporal elements of the processing steps 
executed in a time series in each of the flowcharts can 

25 be regarded as the necessary elements of the present 
invention . This being so, a playback method shown by these 
flowcharts is also considered to be an invention. If the 
processing shown in each flowchart is carried out by 



performing the processing steps in a time series so as to 
achieve the intended aim and the intended effect, it is 
considered as an act of practicing the playback method of 
the present invention. 
[0165] 

(Q) The above embodiments relate to the case where 
the digital stream is an AV clip of the BD-ROM format, but 
the present invention may also be embodied with a VOB (Video 
Object) of the DVD-Video Format or the DVD-Video Recording 
Format. The VOB is a program stream that complies with 
the ISO/IEC 13818-1 Standard and is obtained by multiplexing 
a video stream and an audio stream. Also, the video stream 
in the AV Clip may be an MPEG4 video stream or a WMV video 
stream. Further, the audio stream in the AV clip may be 
a Linear PCM audio stream, a Dolby AC-3 audio stream, an 
MP3 audio stream, an MPEG-AAC audio stream, or a dts audio 
stream. 
[0166] 

(R) The movie content described in the above 
embodiments may be obtained by encoding an analog image 
signal broadcast by analog broadcasting. Alternatively, 
the movie content may be stream data made up of a transport 
stream broadcast by digital broadcasting. 

Alternatively, the movie content may be obtained by 
encoding an analog/digital video signal recorded on 
videotape. Alternatively, the movie content may be 
obtained by encoding an analog/digital signal captured 
directly by a video camera. Alternatively, the video 
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content may bb a digital copyrighted material distributed 

from a distribution server. 

[0167] 

(S) The CM content described in the seventh embodiment 
5 and onwards is visual presentation of CM. Yet, CM may be 
presented by audio. That is, an audio stream presenting 
CM is recorded, and "CCIforSD with CM 7 ' and "CCIforHD with 
CM" may define copy control requiring the audio stream to 
be added to playback output. 

10 (T) The supplemental information described in the 

seventh embodiment and onwards is CM content. Yet, the 
supplemental information may present any messages or some 
kind of information other than CM. In addition, CM content 
may be for any business entity other than a film-production 

15 company or a film-distributing company. 

[0168] 

Industrial Applicability 

The recording medium and the playback device according 

20 to the present invention may be employed for personal use 
in a home theater system. Yet, the present invention may 
be manufactured in volume in accordance with the internal 
structures disclosed in the above embodiments. Thus, the 
recording medium and the playback device of the present 

25 invention can by industrially manufactured or used on an 
industrial scale. Inviewof the above, the recording media 
and the playback devices of the present invention have 
industrial applicability . 



